-- Logs begin at Thu 2021-12-16 15:09:36 UTC, end at Thu 2021-12-16 16:05:47 UTC. -- Dec 16 15:40:12.541134 dv-cinder-784477-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 16 15:40:12.550069 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 16 15:40:12.551957 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Dec 16 15:40:12 2021] *** Dec 16 15:40:12.551957 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 16 15:40:12.551957 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 16 15:40:12.551957 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: nodename: dv-cinder-784477-11-iscsi Dec 16 15:40:12.551957 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: machine: x86_64 Dec 16 15:40:12.551957 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: clock source: unix Dec 16 15:40:12.551957 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: pcre jit disabled Dec 16 15:40:12.551957 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: detected number of CPU cores: 4 Dec 16 15:40:12.551957 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: current working directory: / Dec 16 15:40:12.551957 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: detected binary path: /usr/bin/uwsgi-core Dec 16 15:40:12.552659 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: your processes number limit is 47680 Dec 16 15:40:12.552659 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: your memory page size is 4096 bytes Dec 16 15:40:12.552659 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: detected max file descriptor number: 2048 Dec 16 15:40:12.552659 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: lock engine: pthread robust mutexes Dec 16 15:40:12.552659 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: thunder lock: enabled Dec 16 15:40:12.552659 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 16 15:40:12.552659 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 16 15:40:12.595931 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: Python main interpreter initialized at 0x5615fd5929c0 Dec 16 15:40:12.595931 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: python threads support enabled Dec 16 15:40:12.595931 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: your server socket listen backlog is limited to 100 connections Dec 16 15:40:12.595931 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: your mercy for graceful operations on workers is 90 seconds Dec 16 15:40:12.596269 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: mapped 403077 bytes (393 KB) for 2 cores Dec 16 15:40:12.596269 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: *** Operational MODE: preforking *** Dec 16 15:40:12.596571 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: *** uWSGI is running in multiple interpreter mode *** Dec 16 15:40:12.596571 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: spawned uWSGI master process (pid: 108177) Dec 16 15:40:12.596758 dv-cinder-784477-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 16 15:40:12.598108 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: spawned uWSGI worker 1 (pid: 108178, cores: 1) Dec 16 15:40:12.598108 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: spawned uWSGI worker 2 (pid: 108179, cores: 1) Dec 16 15:40:12.598108 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 16 15:40:14.289221 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 16 15:40:14.289221 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: from cryptography.utils import int_from_bytes Dec 16 15:40:14.289946 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 16 15:40:14.289946 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: from cryptography.utils import int_from_bytes Dec 16 15:40:14.294770 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 16 15:40:14.294770 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: from cryptography.utils import int_from_bytes Dec 16 15:40:14.295263 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 16 15:40:14.295263 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: from cryptography.utils import int_from_bytes Dec 16 15:40:16.803229 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 16 15:40:16.803758 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 16 15:40:16.804121 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 16 15:40:16.804229 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 16 15:40:16.804320 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 16 15:40:16.804398 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 16 15:40:16.804479 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 16 15:40:16.804561 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 16 15:40:16.804650 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 16 15:40:16.804734 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 16 15:40:16.804955 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.805114 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.805255 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.805355 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.805633 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.805765 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.805920 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.806027 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.806283 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.806419 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.806683 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.806817 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.806912 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.806983 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.807237 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.807370 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.807576 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.807713 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.807788 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.807864 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.808142 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.808265 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.808449 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784477-11-iscsi {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.808556 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784477-11-iscsi {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.808789 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.808930 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.809066 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.809160 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.809431 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.809570 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.809727 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.809827 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.810064 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.810185 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.810371 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.810479 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.810668 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.810761 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.811187 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.811337 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.811618 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.811735 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.811933 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.812045 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.812237 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.812373 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.812574 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.812704 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.812888 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.813010 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.813204 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.813342 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.813574 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.813700 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.813884 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.814018 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.814214 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.814354 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.814512 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.814635 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.814922 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784477-11-iscsi {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.815082 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784477-11-iscsi {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.815232 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.815370 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.815547 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.815681 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.815865 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.815995 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.816280 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.816404 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.816595 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.816808 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.816938 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.817066 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.817195 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.817314 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.817558 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.817684 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.817871 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.817999 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.818207 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.818340 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.818527 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.818660 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.818846 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.818972 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.819168 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.819299 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.819472 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.819597 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.819786 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.819924 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.820082 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.820213 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.820409 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.820543 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.820727 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.820859 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.820995 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.821186 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.821321 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.821476 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.821611 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.821742 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.821862 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.821982 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.822203 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.822329 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.822523 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.822665 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.822797 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.822926 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.823055 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.823178 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.823307 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.823428 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.823626 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.823761 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.823941 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.824078 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.824249 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.824374 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.824556 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.824686 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.824860 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.824998 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.825180 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.825316 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.825503 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.825627 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.825813 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.825947 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.826125 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.826251 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.826439 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.826570 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.826761 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.826885 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.827072 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.827196 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.827380 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.827503 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.827696 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.827820 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.828078 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.31 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.828205 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.31 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.828327 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.31 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.828454 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.31 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.828627 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.828750 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.828971 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.829173 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.829339 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.829495 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.829677 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.829801 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.829998 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.830121 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.830319 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.830454 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.830629 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.830751 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.830940 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.831061 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.831255 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.831419 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.831578 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.831721 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.831903 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.832033 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.832211 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.832346 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.832474 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.832604 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.832751 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.832873 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.833060 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.833192 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.833379 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.833531 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.833711 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.833980 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.834106 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.834236 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.834356 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.834484 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.834612 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.834735 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.834899 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.835024 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.835210 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.835333 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.835521 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.835643 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.835828 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.835950 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.836137 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.836261 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.836443 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.836571 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.836752 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.836875 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.837061 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.837188 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.837369 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.837534 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.837716 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.837843 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.838037 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.838159 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.838347 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.838479 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.838655 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.838776 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.838959 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.839080 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.839268 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.839400 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.839591 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.839724 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.839897 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.840021 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.840205 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.840335 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.840524 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.840654 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.840833 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.840955 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.841138 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.841260 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.841480 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.841618 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.841792 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.841913 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.842101 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.842301 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.842423 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.842543 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.842714 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.842836 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.843024 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.843154 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.843338 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.843458 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.843647 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.843770 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.844028 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.844171 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.844294 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.844425 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.844663 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.844799 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.844920 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.845048 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.845198 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.845321 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.845529 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.845666 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.845833 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.845960 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.846137 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.846267 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.846453 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.846581 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.846775 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.846896 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.847083 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.847203 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.847393 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.847521 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.847706 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.847838 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.848027 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.848150 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:40:16.848363 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.848484 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.848695 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.848825 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.849041 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.849163 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.849360 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.849531 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.849721 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.849859 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.850054 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.850176 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.850375 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.850504 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.850687 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.850809 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.851007 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.851130 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.851337 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.851468 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.851650 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.851778 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.851967 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.852088 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.852278 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.852406 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.852602 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.852723 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.852922 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.853043 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.853254 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.853420 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.853598 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.853721 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.853915 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.854053 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.854262 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.854396 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.854517 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.854639 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.854841 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.854971 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.855171 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.855294 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.855495 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.855618 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.855811 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.855937 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.856155 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.856285 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.856498 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.856622 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.857116 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.857242 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.857473 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.857598 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.857797 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.857919 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.858119 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.858249 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.858435 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.858564 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.858750 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.858880 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.859065 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.859198 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.859403 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.859524 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.859717 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.859839 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.860031 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.860164 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.860421 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.860554 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.860741 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.860863 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.861058 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.861192 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.861369 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.861525 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.861705 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.861826 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.862015 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.862154 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.862330 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.862460 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.862632 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.862754 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.862958 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.863081 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.863283 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.863404 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.863592 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.863713 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.863924 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.864048 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.864305 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.864436 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.864557 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.864677 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.864849 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.864981 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.865160 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.865294 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.865495 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.865618 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.865820 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.865941 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.866105 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.866229 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.866430 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.866566 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.866740 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.866863 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.867048 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.867170 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.867369 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.867499 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.867681 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.867803 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.867988 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.868112 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.868303 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.868439 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.868615 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.868738 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.868930 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.869050 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.869242 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.869374 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.869594 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.869717 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.869909 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.870030 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.870222 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.870346 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.870557 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.870679 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.870890 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.871012 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.871201 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.871321 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.871529 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.871656 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.871858 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.871985 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.872176 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.872306 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.872485 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.872605 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.872797 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.872917 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.873107 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.873232 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.873425 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.873550 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.873746 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.873878 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.874057 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.874177 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.874370 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.874500 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.874678 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.874787 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.874982 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.875085 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.875288 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.875383 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.875595 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.875710 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.875943 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.876057 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.876254 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.876351 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.876561 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.876665 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.876868 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.876967 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.877170 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.877263 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.877539 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.877638 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.877851 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.877936 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.878190 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.878275 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.878524 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.878615 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.878844 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.878931 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.879170 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.879256 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.879483 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.879579 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.879801 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.879888 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.880114 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.880199 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.880426 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.880519 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.880737 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.880824 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.881050 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.881144 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.881369 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.881471 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.881706 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.881792 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.882027 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.882130 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.882338 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.882424 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.882662 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.882748 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.882973 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.883068 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.883294 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.883386 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.883598 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.883683 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.883916 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.884011 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.884258 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.884343 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.884591 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.884687 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.884908 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.885004 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.885232 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.885326 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.885571 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.885673 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.885888 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.885986 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.886198 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.886297 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.886511 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.886605 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.886821 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.886914 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.887132 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.887225 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.887451 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.887539 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.887765 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.887858 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.888086 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.888189 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.888396 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.888481 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.888719 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.888805 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.889031 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.889117 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.889350 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.889481 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.889683 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.889769 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.889998 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.890083 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.890329 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.890422 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.890663 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.890755 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.890976 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.891061 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.891290 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.891385 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.891668 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.891770 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.891987 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.892072 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.892308 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.892410 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.892611 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.892698 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.892919 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.893003 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.893230 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.893326 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.893567 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.893667 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.893889 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.893974 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.894201 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.894287 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.894514 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.894606 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.894821 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.894907 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.895141 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.895229 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.895452 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.895540 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.895760 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.895847 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.896066 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.896155 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.896377 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.896462 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.896703 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.896788 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.897017 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.897102 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.897342 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.897470 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.897698 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.897802 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.898006 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.898093 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.898312 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.898404 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.898639 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.898733 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.898952 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.899036 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.899257 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.899342 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.899562 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.899655 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.899868 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.899952 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.900216 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.900301 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.900532 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.900627 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.900842 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.900934 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.901159 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.901244 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.901507 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.901596 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.901823 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.901908 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.902139 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.902235 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.902453 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.902541 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.902768 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.902860 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.903095 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.903180 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.903415 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.903501 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.903727 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.903813 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.904042 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.904135 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.904351 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.904444 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.904664 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.904790 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.904980 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.905075 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.905301 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.905388 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.905641 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.905732 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.905957 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.906057 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.906270 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.906355 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.906576 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.906664 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.906889 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.906983 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.907237 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.907323 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.907808 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.907893 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.908144 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.908237 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.908465 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.908550 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.908785 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.908877 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.909109 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.909197 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.909452 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.909543 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.909796 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.909892 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.910130 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.910218 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.910449 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.910534 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.910760 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.910845 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.911077 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.911164 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.911387 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.911473 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.911696 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.911783 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.912012 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.912103 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.912322 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.912416 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.912630 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.912730 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.912939 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.913032 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.913250 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.913337 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.913582 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.913682 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.913893 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.913980 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.914240 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.914326 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.914549 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.914651 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.914866 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.914961 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.915172 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.915260 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.915486 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.915572 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.915793 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.915888 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.916120 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.916243 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.916431 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.916518 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.916739 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.916839 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.917044 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.917137 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.917351 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.917483 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.917727 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.917824 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.918035 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.918119 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.918374 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.918459 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.918702 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.918797 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.919046 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.919139 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.919355 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.919445 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.919662 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.919749 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.919989 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.920075 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.920297 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.920381 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.920602 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.920696 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.920908 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.920993 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.921217 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.921303 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.921552 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.921640 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.921855 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.921940 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.922166 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.922269 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.922481 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.922567 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.922843 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.922928 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.923158 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.923252 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.923463 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.923549 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.923776 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.923884 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.924079 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.924176 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.924394 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.924480 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.924706 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.924800 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.925011 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.925110 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.925314 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.925415 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.925656 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.925742 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.925963 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.926064 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.926269 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.926356 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.926578 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.926711 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.926885 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.926972 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.927201 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.927287 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.927509 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.927603 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.927815 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.927932 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.928118 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.928207 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.928428 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.928514 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.928737 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.928824 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.929042 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.929129 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.929368 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.929497 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.929701 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.929795 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.930007 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.930095 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.930307 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.930406 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.930615 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.930701 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.930918 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.931005 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.931225 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.931318 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.931533 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.931619 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.931856 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.931967 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.932172 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.932269 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.932477 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.932578 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.932786 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.932873 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.933090 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.933186 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.933393 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.933550 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.933717 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.933805 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.934028 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.934117 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.934334 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.934426 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.934638 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.934731 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.934944 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.935031 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.935247 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.935334 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.935554 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.935639 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.935874 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.935975 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.936187 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.936279 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.936487 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.936572 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.936793 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.936879 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.937092 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.937176 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.937463 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.937572 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.937764 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.937849 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.938123 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.938209 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.938483 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.938579 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.938805 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.938897 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.939122 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.939253 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.939434 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.939523 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.939747 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.939834 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.940062 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.940150 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.940367 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.940466 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.940684 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.940770 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.940996 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.941091 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.941308 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.941395 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.941641 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.941728 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.941950 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.942047 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.942272 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.942359 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.942585 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.942672 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.942898 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.942990 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.943221 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.943308 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.943543 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.943637 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.943867 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.943961 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.944173 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.944266 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.944484 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.944569 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.944796 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.944891 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.945105 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.945237 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.945425 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.945535 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.945753 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.945861 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.946067 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.946157 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.946382 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.946493 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.946692 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.946810 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.947003 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.947093 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.947314 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.947403 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.947625 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.947722 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.947936 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.948023 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.948247 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.948343 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.948557 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.948638 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.948881 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.948971 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.949194 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.949281 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.949522 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.949623 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.949833 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.949922 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.950139 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.950236 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.950450 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.950539 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.950757 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.950846 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.951184 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.951274 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.951503 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.951591 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.951812 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.951900 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.952118 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.952216 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.952430 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.952519 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.952740 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.952829 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.953055 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.953152 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.953374 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.953481 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.953707 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.953807 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.954152 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.954249 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.954469 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.954557 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.954783 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.954871 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.955095 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.955208 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.955404 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.955510 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.955709 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.955806 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.956020 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.956117 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.956349 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.956436 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.956661 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.956754 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.956971 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.957068 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.957281 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.957370 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.957635 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.957725 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.957942 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.958031 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.958266 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.958354 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.958680 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.958769 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.958996 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.959085 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.959300 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.959396 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.959714 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.959812 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.960028 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.960116 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.960338 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.960433 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.960664 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.960765 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.960983 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.961070 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.961307 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.961396 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.961643 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.961745 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.961957 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.962046 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.962266 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.962355 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.962592 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.962690 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.962916 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.963005 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.963228 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.963317 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.963540 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.963638 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.963847 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.963934 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.964167 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.964256 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.964491 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.964585 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.964801 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.964895 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.965124 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.965220 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.965562 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.965668 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.965891 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.966000 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.966207 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.966310 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.966532 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.966620 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.966855 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.966951 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.967167 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.967265 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.967469 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.967556 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.967783 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.967871 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.968091 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.968178 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.968399 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.968499 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.968723 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.968813 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.969030 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.969118 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.969341 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.969460 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.969732 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.969830 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.970046 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.970140 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.970357 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.970458 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.970665 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.970756 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.970991 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.971084 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.971298 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.971398 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.971622 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.971714 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.971938 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.972032 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.972266 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.972360 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.972587 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.972679 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.972897 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.972987 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.973220 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.973311 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.973556 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.973649 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.973863 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.973947 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.974167 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.974254 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.974471 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.974563 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.974816 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.974907 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.975123 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.975208 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.975446 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.975546 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.975782 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.975896 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.976114 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.976200 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.976426 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.976509 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.976758 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.976850 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.977088 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.977171 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.977425 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.977513 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.977754 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.977856 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.978078 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.978163 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.978386 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.978481 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.978697 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.978792 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.979008 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.979093 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.979315 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.979400 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.979620 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.979706 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.979926 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.980018 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.980238 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.980324 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.980544 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.980630 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.980849 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.980942 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.981153 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.981238 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.981497 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.981585 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.982104 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.982193 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.982438 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.982525 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.982751 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.982836 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.983057 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.983143 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.983363 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.983496 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.983667 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.983788 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.984011 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.984132 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.984319 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.984488 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.984652 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.984780 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.984970 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.985093 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.985321 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.985487 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.985680 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.985876 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.986009 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.986136 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.986303 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.986436 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.986622 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.986755 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.986938 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.987062 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.987256 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.987379 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.987575 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.987697 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.987892 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.988021 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.988210 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.988333 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.988527 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.988649 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.988835 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.988964 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.989154 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.989277 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.989500 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.989628 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.989818 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.989954 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.990344 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.990468 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.990676 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.990806 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.990995 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.991126 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.991309 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.991438 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.991623 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.991745 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.991940 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.992072 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.992258 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.992382 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.992576 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.992700 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.992888 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.993098 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.993222 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.993344 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.993535 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.993657 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.993839 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.993964 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.994163 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.994294 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.994492 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.994615 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.994828 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.994950 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.995142 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.995265 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.995457 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.995580 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.995771 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.995916 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.996110 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.996242 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.996434 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.996604 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.996752 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.996874 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.997060 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.997191 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.997376 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.997524 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.997718 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.997841 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.998031 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.998159 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.998344 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.998474 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.998652 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.998774 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.998969 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.999087 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.999284 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.999406 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.999594 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.999724 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:16.999905 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.000027 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.000217 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.000341 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.000532 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.000663 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.000877 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.001022 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.001245 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.001371 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.001593 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.001715 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.001907 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.002046 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.002226 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.002356 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.002546 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.002667 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.003056 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.003186 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.003373 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.003496 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.003705 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.003827 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.004033 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.004208 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.004359 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.004480 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.004674 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.004798 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.004992 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.005116 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.005319 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.005505 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.005638 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.005758 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.005951 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.006089 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.006281 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.006411 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.006562 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.006693 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.006871 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.006992 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.007191 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.007311 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.007504 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.007627 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.007812 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.007933 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.008133 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.008255 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.008446 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.008575 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.008968 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.009097 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.009311 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.009531 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.009654 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.009786 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.009977 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.010100 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.010304 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.010426 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.010622 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.010757 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.010932 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.011055 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.011255 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.011379 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.011564 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.011687 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.011872 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.011996 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.012189 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.012310 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.012502 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.012626 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.012808 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.012935 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.013112 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.013234 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.013440 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.013567 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.013753 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.013876 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.014058 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.014181 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.014373 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.014494 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.014676 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.014805 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.015002 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.015134 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.015314 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.015443 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.015619 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.015740 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.015924 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.016057 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.016240 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.016439 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.016571 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.016691 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.016866 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.016999 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.017174 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.017295 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.017506 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.017643 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.017823 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.018126 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.018271 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.018393 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.018514 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.018642 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.018777 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.018912 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.019034 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.019155 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.019315 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.019441 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.019628 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.019760 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.019934 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.020059 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.020260 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.020386 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.020569 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.020691 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.020874 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.020996 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.021191 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.021322 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.021530 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.021654 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.021855 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.021977 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.022167 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.022298 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.022479 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.022603 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.022828 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.022959 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.023149 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.023279 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.023678 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.023802 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.024061 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.024183 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.024382 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.024514 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.024726 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.024850 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.025070 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.025217 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.025381 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.025662 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.025794 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.025914 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.026035 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.026155 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.026323 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.026457 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.026641 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.026780 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.026931 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.027068 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.027241 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.027363 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.027556 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.027693 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.027868 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.027990 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.028178 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.028300 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.028489 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.028624 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.028799 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.028937 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.029109 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.029231 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.029443 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.029570 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.029789 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.029930 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.030109 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.030244 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.030430 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.030559 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.030744 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.030880 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.031061 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.031193 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.031375 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.031499 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.031686 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.031823 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.031998 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.032163 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.032359 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.032483 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.032678 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.032808 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.032995 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.033127 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.033312 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.033445 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.033648 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.033779 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.034066 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.034195 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.034384 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.034506 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.034702 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.034825 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.035027 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.035151 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.035337 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.035469 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.035662 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.035799 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.035989 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.036113 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.036303 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.036436 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.036693 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.036824 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.036945 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.037078 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.037249 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.037382 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.037612 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.037736 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.037943 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.038076 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.038269 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.038400 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.038575 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.038699 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.038880 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.039004 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.039190 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.039339 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.039496 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.039627 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.039824 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.039955 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.040160 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.040291 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.040472 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.040593 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.040796 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.040928 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.041110 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.041234 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.041451 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.041580 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.041766 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.041906 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.042090 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.042214 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.042417 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.042545 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.042731 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.042861 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.043042 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.043166 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.043373 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.043498 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.043683 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.043819 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.043995 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.044119 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.044306 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.044431 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.044618 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.044742 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.044927 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.045053 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.045238 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.045361 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.045588 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.045712 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.045909 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.046031 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.046215 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.046338 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.046540 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.046665 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.046874 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.047000 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.047163 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.047296 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.047482 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.047606 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.047823 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.047951 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.048154 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.048285 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.048464 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.048597 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.048780 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.048912 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.049094 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.049227 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.049433 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.049558 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.049751 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.049886 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.050068 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.050191 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.050394 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.050516 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.050724 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.050853 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.051049 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.051177 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.051376 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.051500 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.051721 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.051862 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.052039 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.052162 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.052383 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.052506 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.052712 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.052837 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.053026 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.053148 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.053385 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.053539 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.053662 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.053798 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:40:17.053922 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 16 15:40:17.054043 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 16 15:40:17.076727 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG oslo_db.sqlalchemy.engines [None req-569a6f67-7fac-4667-b6ff-d2512ec95439 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 16 15:40:17.077847 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG oslo_db.sqlalchemy.engines [None req-4b00c97f-d6e0-43de-bd6b-fd9cb21912f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 16 15:40:17.143808 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.context [None req-4b00c97f-d6e0-43de-bd6b-fd9cb21912f1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),23718866-586d-4970-8765-992ef61502a3(cell1) {{(pid=108178) load_cells /opt/stack/nova/nova/context.py:464}} Dec 16 15:40:17.144029 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.context [None req-569a6f67-7fac-4667-b6ff-d2512ec95439 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),23718866-586d-4970-8765-992ef61502a3(cell1) {{(pid=108179) load_cells /opt/stack/nova/nova/context.py:464}} Dec 16 15:40:17.148071 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG oslo_concurrency.lockutils [None req-4b00c97f-d6e0-43de-bd6b-fd9cb21912f1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:40:17.148298 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG oslo_concurrency.lockutils [None req-569a6f67-7fac-4667-b6ff-d2512ec95439 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:40:17.149682 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG oslo_concurrency.lockutils [None req-4b00c97f-d6e0-43de-bd6b-fd9cb21912f1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:40:17.149967 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG oslo_concurrency.lockutils [None req-569a6f67-7fac-4667-b6ff-d2512ec95439 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:40:17.150469 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG oslo_concurrency.lockutils [None req-4b00c97f-d6e0-43de-bd6b-fd9cb21912f1 None None] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:40:17.150783 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG oslo_concurrency.lockutils [None req-569a6f67-7fac-4667-b6ff-d2512ec95439 None None] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:40:17.152399 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG oslo_concurrency.lockutils [None req-4b00c97f-d6e0-43de-bd6b-fd9cb21912f1 None None] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:40:17.152730 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG oslo_concurrency.lockutils [None req-569a6f67-7fac-4667-b6ff-d2512ec95439 None None] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:40:17.163406 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG oslo_db.sqlalchemy.engines [None req-4b00c97f-d6e0-43de-bd6b-fd9cb21912f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 16 15:40:17.166556 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG oslo_db.sqlalchemy.engines [None req-4b00c97f-d6e0-43de-bd6b-fd9cb21912f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 16 15:40:17.169753 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG oslo_db.sqlalchemy.engines [None req-569a6f67-7fac-4667-b6ff-d2512ec95439 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 16 15:40:17.172014 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG oslo_db.sqlalchemy.engines [None req-569a6f67-7fac-4667-b6ff-d2512ec95439 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 16 15:40:17.333429 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG oslo_db.sqlalchemy.engines [None req-4b00c97f-d6e0-43de-bd6b-fd9cb21912f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 16 15:40:17.336239 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG oslo_db.sqlalchemy.engines [None req-569a6f67-7fac-4667-b6ff-d2512ec95439 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 16 15:40:17.672107 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: WARNING keystonemiddleware.auth_token [None req-569a6f67-7fac-4667-b6ff-d2512ec95439 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 15:40:17.677587 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: WARNING keystonemiddleware.auth_token [None req-4b00c97f-d6e0-43de-bd6b-fd9cb21912f1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 15:40:17.678790 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: WARNING keystonemiddleware.auth_token [None req-569a6f67-7fac-4667-b6ff-d2512ec95439 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 15:40:17.684223 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: WARNING keystonemiddleware.auth_token [None req-4b00c97f-d6e0-43de-bd6b-fd9cb21912f1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 15:40:18.013513 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: WARNING keystonemiddleware.auth_token [None req-569a6f67-7fac-4667-b6ff-d2512ec95439 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 15:40:18.018807 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: WARNING keystonemiddleware.auth_token [None req-569a6f67-7fac-4667-b6ff-d2512ec95439 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 15:40:18.021153 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: WARNING keystonemiddleware.auth_token [None req-4b00c97f-d6e0-43de-bd6b-fd9cb21912f1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 15:40:18.023951 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5615fd5929c0 pid: 108179 (default app) Dec 16 15:40:18.026048 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-569a6f67-7fac-4667-b6ff-d2512ec95439 None None] Calling method '>' {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:40:18.026487 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: WARNING keystonemiddleware.auth_token [None req-4b00c97f-d6e0-43de-bd6b-fd9cb21912f1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 15:40:18.027240 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-569a6f67-7fac-4667-b6ff-d2512ec95439 None None] 10.222.0.31 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001757 Dec 16 15:40:18.027654 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 1/1] 10.222.0.31 () {50 vars in 788 bytes} [Thu Dec 16 15:40:18 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:40:18.031547 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5615fd5929c0 pid: 108178 (default app) Dec 16 15:41:39.612341 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-569a6f67-7fac-4667-b6ff-d2512ec95439 None None] Calling method '>' {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:41:39.614091 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-569a6f67-7fac-4667-b6ff-d2512ec95439 None None] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002153 Dec 16 15:41:39.614649 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 2/2] 10.222.0.31 () {54 vars in 930 bytes} [Thu Dec 16 15:41:39 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:41:40.021175 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-8dbcdc34-02bf-46a5-8da6-303975ddb653 admin admin] Calling method '>' {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:41:40.050203 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-8dbcdc34-02bf-46a5-8da6-303975ddb653 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.428087 Dec 16 15:41:40.051236 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 1/3] 10.222.0.31 () {60 vars in 1291 bytes} [Thu Dec 16 15:41:39 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:41:42.418181 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-569a6f67-7fac-4667-b6ff-d2512ec95439 None None] Calling method '>' {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:41:42.419170 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-569a6f67-7fac-4667-b6ff-d2512ec95439 None None] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Dec 16 15:41:42.419537 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 3/4] 10.222.0.31 () {54 vars in 930 bytes} [Thu Dec 16 15:41:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:41:42.481198 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-8e99ce57-10d8-4814-bf69-5a2d1ef77fff admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "cirros256", "vcpus": 1, "swap": 0, "ram": 256, "disk": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1"}} {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:41:42.499013 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:41:42.499013 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: warnings.warn(msg) Dec 16 15:41:42.527781 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-8e99ce57-10d8-4814-bf69-5a2d1ef77fff admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.101894 Dec 16 15:41:42.528263 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 2/5] 10.222.0.31 () {64 vars in 1282 bytes} [Thu Dec 16 15:41:42 2021] POST /compute/v2.1/flavors => generated 407 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:41:42.741065 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-09de79ea-2036-43a6-a1ee-fc73fd20e8d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:41:42.743482 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:41:42.743482 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: warnings.warn(msg) Dec 16 15:41:42.795643 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-09de79ea-2036-43a6-a1ee-fc73fd20e8d7 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.258437 Dec 16 15:41:42.796517 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 4/6] 10.222.0.31 () {64 vars in 1335 bytes} [Thu Dec 16 15:41:42 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:41:45.168652 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-8e99ce57-10d8-4814-bf69-5a2d1ef77fff admin admin] Calling method '>' {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:41:45.169949 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-8e99ce57-10d8-4814-bf69-5a2d1ef77fff admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001631 Dec 16 15:41:45.170520 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 3/7] 10.222.0.31 () {54 vars in 930 bytes} [Thu Dec 16 15:41:45 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:41:45.291357 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-234f306c-91fe-431c-b3bc-dbdaa9abee48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "id": "d1", "vcpus": 1, "name": "ds512M", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 512}} {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:41:45.309282 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:41:45.309282 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: warnings.warn(msg) Dec 16 15:41:45.330402 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-234f306c-91fe-431c-b3bc-dbdaa9abee48 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.153095 Dec 16 15:41:45.331243 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 5/8] 10.222.0.31 () {64 vars in 1282 bytes} [Thu Dec 16 15:41:45 2021] POST /compute/v2.1/flavors => generated 404 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:41:45.344293 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-61b35619-7f18-4b2a-81ca-5983d10b2114 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:41:45.345771 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:41:45.345771 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: warnings.warn(msg) Dec 16 15:41:45.384802 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-61b35619-7f18-4b2a-81ca-5983d10b2114 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044358 Dec 16 15:41:45.385512 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 4/9] 10.222.0.31 () {64 vars in 1335 bytes} [Thu Dec 16 15:41:45 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:41:47.806566 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-234f306c-91fe-431c-b3bc-dbdaa9abee48 admin admin] Calling method '>' {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:41:47.807573 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-234f306c-91fe-431c-b3bc-dbdaa9abee48 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Dec 16 15:41:47.808007 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 6/10] 10.222.0.31 () {54 vars in 930 bytes} [Thu Dec 16 15:41:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:41:47.864361 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-9495eb0e-5187-4868-956b-d955ff7d13a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "id": "d2", "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "ram": 1024}} {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:41:47.889308 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-9495eb0e-5187-4868-956b-d955ff7d13a9 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074750 Dec 16 15:41:47.889894 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 5/11] 10.222.0.31 () {64 vars in 1282 bytes} [Thu Dec 16 15:41:47 2021] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 15:41:47.902604 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-c8865ae8-b341-4cfc-ad0d-09ddc9402998 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:41:47.926920 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-c8865ae8-b341-4cfc-ad0d-09ddc9402998 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028021 Dec 16 15:41:47.927504 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 7/12] 10.222.0.31 () {64 vars in 1335 bytes} [Thu Dec 16 15:41:47 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:41:50.332051 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-9495eb0e-5187-4868-956b-d955ff7d13a9 admin admin] Calling method '>' {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:41:50.333192 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-9495eb0e-5187-4868-956b-d955ff7d13a9 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Dec 16 15:41:50.333876 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 6/13] 10.222.0.31 () {54 vars in 930 bytes} [Thu Dec 16 15:41:50 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:41:50.394275 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-f174d3cf-5612-43f2-8d99-53eb96b8e378 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "swap": 0, "id": "d3", "disk": 10, "name": "ds2G"}} {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:41:50.414164 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-f174d3cf-5612-43f2-8d99-53eb96b8e378 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074107 Dec 16 15:41:50.414716 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 8/14] 10.222.0.31 () {64 vars in 1282 bytes} [Thu Dec 16 15:41:50 2021] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 15:41:50.427663 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-7ffb8011-2ce6-4381-a4b8-9c90745d9852 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:41:50.451813 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-7ffb8011-2ce6-4381-a4b8-9c90745d9852 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028071 Dec 16 15:41:50.452396 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 7/15] 10.222.0.31 () {64 vars in 1335 bytes} [Thu Dec 16 15:41:50 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:41:52.831596 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-f174d3cf-5612-43f2-8d99-53eb96b8e378 admin admin] Calling method '>' {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:41:52.832599 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-f174d3cf-5612-43f2-8d99-53eb96b8e378 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Dec 16 15:41:52.833268 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 9/16] 10.222.0.31 () {54 vars in 930 bytes} [Thu Dec 16 15:41:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:41:52.894693 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-52163b67-0b65-4d8a-aa33-ea9e103f53d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "vcpus": 4, "os-flavor-access:is_public": true, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "swap": 0, "disk": 20}} {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:41:52.916356 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-52163b67-0b65-4d8a-aa33-ea9e103f53d4 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076442 Dec 16 15:41:52.917241 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 8/17] 10.222.0.31 () {64 vars in 1282 bytes} [Thu Dec 16 15:41:52 2021] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 15:41:52.929964 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-bf2b260b-ec09-44e5-9029-531860ed6b97 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:41:52.963352 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-bf2b260b-ec09-44e5-9029-531860ed6b97 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036997 Dec 16 15:41:52.971614 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 10/18] 10.222.0.31 () {64 vars in 1335 bytes} [Thu Dec 16 15:41:52 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:41:55.468308 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-52163b67-0b65-4d8a-aa33-ea9e103f53d4 admin admin] Calling method '>' {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:41:55.469374 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-52163b67-0b65-4d8a-aa33-ea9e103f53d4 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Dec 16 15:41:55.469835 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 9/19] 10.222.0.31 () {54 vars in 930 bytes} [Thu Dec 16 15:41:55 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:41:55.529435 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-8359d30e-8f66-4f1e-99b1-2989dfd329a1 admin admin] Calling method '>' {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:41:55.552897 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-8359d30e-8f66-4f1e-99b1-2989dfd329a1 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076628 Dec 16 15:41:55.553463 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 11/20] 10.222.0.31 () {60 vars in 1291 bytes} [Thu Dec 16 15:41:55 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:41:57.950210 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-52163b67-0b65-4d8a-aa33-ea9e103f53d4 admin admin] Calling method '>' {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:41:57.951364 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-52163b67-0b65-4d8a-aa33-ea9e103f53d4 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001614 Dec 16 15:41:57.951782 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 10/21] 10.222.0.31 () {54 vars in 930 bytes} [Thu Dec 16 15:41:57 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:41:58.012874 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-ec9a6746-c5e9-4daa-bf34-0ec26785470e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "id": "1", "swap": 0, "disk": 1}} {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:41:58.033945 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-ec9a6746-c5e9-4daa-bf34-0ec26785470e admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.075148 Dec 16 15:41:58.034542 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 12/22] 10.222.0.31 () {64 vars in 1282 bytes} [Thu Dec 16 15:41:57 2021] POST /compute/v2.1/flavors => generated 402 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:41:58.048156 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-52affb84-aaa8-4fef-83ca-7881f926b5a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:41:58.075828 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-52affb84-aaa8-4fef-83ca-7881f926b5a6 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032410 Dec 16 15:41:58.076478 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 11/23] 10.222.0.31 () {64 vars in 1332 bytes} [Thu Dec 16 15:41:58 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:42:00.459099 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-ec9a6746-c5e9-4daa-bf34-0ec26785470e admin admin] Calling method '>' {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:42:00.460110 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-ec9a6746-c5e9-4daa-bf34-0ec26785470e admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Dec 16 15:42:00.460508 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 13/24] 10.222.0.31 () {54 vars in 930 bytes} [Thu Dec 16 15:42:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:42:00.535223 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-49f65f88-bd38-4c1d-8789-378de4135efb admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 20, "rxtx_factor": 1.0, "swap": 0, "name": "m1.small", "id": "2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:42:00.557069 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-49f65f88-bd38-4c1d-8789-378de4135efb admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.087034 Dec 16 15:42:00.557808 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 12/25] 10.222.0.31 () {64 vars in 1282 bytes} [Thu Dec 16 15:42:00 2021] POST /compute/v2.1/flavors => generated 405 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 15:42:00.570345 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-4f37dde8-99bd-4f65-b815-3fefc7608087 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:42:00.595040 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-4f37dde8-99bd-4f65-b815-3fefc7608087 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028368 Dec 16 15:42:00.595622 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 14/26] 10.222.0.31 () {64 vars in 1332 bytes} [Thu Dec 16 15:42:00 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:42:02.954951 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-49f65f88-bd38-4c1d-8789-378de4135efb admin admin] Calling method '>' {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:42:02.955981 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-49f65f88-bd38-4c1d-8789-378de4135efb admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Dec 16 15:42:02.956369 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 13/27] 10.222.0.31 () {54 vars in 930 bytes} [Thu Dec 16 15:42:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:42:03.016687 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-1ce1b460-fabb-4c0b-9df5-6829c36617de admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "os-flavor-access:is_public": true, "name": "m1.medium", "ram": 4096, "id": "3", "swap": 0}} {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:42:03.038518 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-1ce1b460-fabb-4c0b-9df5-6829c36617de admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.075260 Dec 16 15:42:03.039066 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 15/28] 10.222.0.31 () {64 vars in 1282 bytes} [Thu Dec 16 15:42:02 2021] POST /compute/v2.1/flavors => generated 406 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:42:03.051228 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-5d692fe0-3474-4412-8cdf-eb0bdc3fca0b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:42:03.075053 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-5d692fe0-3474-4412-8cdf-eb0bdc3fca0b admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027599 Dec 16 15:42:03.075650 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 14/29] 10.222.0.31 () {64 vars in 1332 bytes} [Thu Dec 16 15:42:03 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:42:05.454097 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-1ce1b460-fabb-4c0b-9df5-6829c36617de admin admin] Calling method '>' {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:42:05.456292 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-1ce1b460-fabb-4c0b-9df5-6829c36617de admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002717 Dec 16 15:42:05.457268 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 16/30] 10.222.0.31 () {54 vars in 930 bytes} [Thu Dec 16 15:42:05 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:42:05.529255 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-b1a0f9e4-698a-4351-bf13-74a5e049c523 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "name": "m1.large", "id": "4", "ram": 8192, "rxtx_factor": 1.0}} {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:42:05.548667 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-b1a0f9e4-698a-4351-bf13-74a5e049c523 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.084734 Dec 16 15:42:05.549507 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 15/31] 10.222.0.31 () {64 vars in 1282 bytes} [Thu Dec 16 15:42:05 2021] POST /compute/v2.1/flavors => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:42:05.562944 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-daf73012-5140-455d-89a8-384f42257dee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:42:05.587076 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-daf73012-5140-455d-89a8-384f42257dee admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027861 Dec 16 15:42:05.587642 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 17/32] 10.222.0.31 () {64 vars in 1332 bytes} [Thu Dec 16 15:42:05 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:42:07.994121 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-b1a0f9e4-698a-4351-bf13-74a5e049c523 admin admin] Calling method '>' {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:42:07.995288 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-b1a0f9e4-698a-4351-bf13-74a5e049c523 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Dec 16 15:42:07.995765 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 16/33] 10.222.0.31 () {54 vars in 930 bytes} [Thu Dec 16 15:42:07 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:42:08.058835 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-d3db8eb6-7e89-455c-bfc0-f97283863a48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 8, "id": "5", "os-flavor-access:is_public": true, "disk": 160, "ram": 16384}} {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:42:08.077763 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-d3db8eb6-7e89-455c-bfc0-f97283863a48 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.075414 Dec 16 15:42:08.078558 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 18/34] 10.222.0.31 () {64 vars in 1282 bytes} [Thu Dec 16 15:42:08 2021] POST /compute/v2.1/flavors => generated 408 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 15:42:08.090899 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-4f00a6f0-49cd-4301-86fd-21e1086c16d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:42:08.125757 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-4f00a6f0-49cd-4301-86fd-21e1086c16d2 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031959 Dec 16 15:42:08.125757 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 17/35] 10.222.0.31 () {64 vars in 1332 bytes} [Thu Dec 16 15:42:08 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:42:29.322006 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-d3db8eb6-7e89-455c-bfc0-f97283863a48 admin admin] Calling method '>' {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:42:29.323004 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-d3db8eb6-7e89-455c-bfc0-f97283863a48 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Dec 16 15:42:29.323408 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 19/36] 10.222.0.31 () {54 vars in 930 bytes} [Thu Dec 16 15:42:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:42:29.388109 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-86a8052d-d9bc-4330-9a27-ade19c38ea0f admin admin] Calling method '>' {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:42:29.404972 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-86a8052d-d9bc-4330-9a27-ade19c38ea0f admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.074672 Dec 16 15:42:29.405523 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 18/37] 10.222.0.31 () {60 vars in 1291 bytes} [Thu Dec 16 15:42:29 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:42:31.009163 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-d3db8eb6-7e89-455c-bfc0-f97283863a48 admin admin] Calling method '>' {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:42:31.010237 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-d3db8eb6-7e89-455c-bfc0-f97283863a48 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Dec 16 15:42:31.010639 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 20/38] 10.222.0.31 () {56 vars in 1074 bytes} [Thu Dec 16 15:42:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:42:31.213123 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-dd7f4fd1-9423-472b-826e-f6136d8b560d admin admin] Calling method '>' {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:42:31.218866 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.wsgi [None req-dd7f4fd1-9423-472b-826e-f6136d8b560d admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 16 15:42:31.219464 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-dd7f4fd1-9423-472b-826e-f6136d8b560d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:42:31.220272 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-dd7f4fd1-9423-472b-826e-f6136d8b560d admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.070614 Dec 16 15:42:31.220783 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 19/39] 10.222.0.31 () {60 vars in 1190 bytes} [Thu Dec 16 15:42:31 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 16 15:42:31.231588 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-58b89138-9f5b-43df-a702-8ff318ed5c68 admin admin] Calling method '>' {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:42:31.253785 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-58b89138-9f5b-43df-a702-8ff318ed5c68 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026453 Dec 16 15:42:31.254341 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 21/40] 10.222.0.31 () {60 vars in 1210 bytes} [Thu Dec 16 15:42:31 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:42:31.265367 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-21b1232b-6776-451c-96e9-8aebf349c0e4 admin admin] Calling method '>' {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:42:31.287457 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-21b1232b-6776-451c-96e9-8aebf349c0e4 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026001 Dec 16 15:42:31.287987 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 20/41] 10.222.0.31 () {60 vars in 1210 bytes} [Thu Dec 16 15:42:31 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:42:31.297763 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-34381227-afcf-49f4-a793-7c9a2ab993d2 admin admin] Calling method '>' {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:42:31.303204 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.wsgi [None req-34381227-afcf-49f4-a793-7c9a2ab993d2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 16 15:42:31.303763 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-34381227-afcf-49f4-a793-7c9a2ab993d2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:42:31.304549 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-34381227-afcf-49f4-a793-7c9a2ab993d2 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010339 Dec 16 15:42:31.305033 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 22/42] 10.222.0.31 () {60 vars in 1190 bytes} [Thu Dec 16 15:42:31 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Dec 16 15:42:32.778354 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-21b1232b-6776-451c-96e9-8aebf349c0e4 admin admin] Calling method '>' {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:42:32.779581 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-21b1232b-6776-451c-96e9-8aebf349c0e4 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Dec 16 15:42:32.780072 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 21/43] 10.222.0.31 () {56 vars in 1074 bytes} [Thu Dec 16 15:42:32 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:42:32.978221 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-509ad3a1-75ec-41af-a3d0-3a458734b464 admin admin] Calling method '>' {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:42:32.984158 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.wsgi [None req-509ad3a1-75ec-41af-a3d0-3a458734b464 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 16 15:42:32.984713 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-509ad3a1-75ec-41af-a3d0-3a458734b464 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:42:32.985541 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-509ad3a1-75ec-41af-a3d0-3a458734b464 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.069358 Dec 16 15:42:32.986049 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 23/44] 10.222.0.31 () {60 vars in 1190 bytes} [Thu Dec 16 15:42:32 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 16 15:42:32.998825 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-94434927-3145-4e47-a667-8c90860c3bab admin admin] Calling method '>' {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:42:33.012651 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-94434927-3145-4e47-a667-8c90860c3bab admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019482 Dec 16 15:42:33.013175 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 22/45] 10.222.0.31 () {60 vars in 1210 bytes} [Thu Dec 16 15:42:32 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:42:33.022963 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-f60331e9-e454-41c7-8db3-1f41fb55db94 admin admin] Calling method '>' {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:42:33.036698 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-f60331e9-e454-41c7-8db3-1f41fb55db94 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017126 Dec 16 15:42:33.037242 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 24/46] 10.222.0.31 () {60 vars in 1210 bytes} [Thu Dec 16 15:42:33 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:42:33.048101 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-ac7d99ca-612a-4b5e-8766-f717ac4baa37 admin admin] Calling method '>' {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:42:33.053960 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.wsgi [None req-ac7d99ca-612a-4b5e-8766-f717ac4baa37 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 16 15:42:33.054604 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-ac7d99ca-612a-4b5e-8766-f717ac4baa37 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:42:33.055426 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-ac7d99ca-612a-4b5e-8766-f717ac4baa37 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011696 Dec 16 15:42:33.055944 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 23/47] 10.222.0.31 () {60 vars in 1190 bytes} [Thu Dec 16 15:42:33 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 16 15:42:34.540712 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-f60331e9-e454-41c7-8db3-1f41fb55db94 admin admin] Calling method '>' {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:42:34.541941 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-f60331e9-e454-41c7-8db3-1f41fb55db94 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001724 Dec 16 15:42:34.542332 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 25/48] 10.222.0.31 () {56 vars in 1074 bytes} [Thu Dec 16 15:42:34 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:42:34.745579 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-3fb70a59-4026-48c3-9437-3bc14f47448a admin admin] Calling method '>' {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:42:34.751457 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.wsgi [None req-3fb70a59-4026-48c3-9437-3bc14f47448a admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 16 15:42:34.752021 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-3fb70a59-4026-48c3-9437-3bc14f47448a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:42:34.752843 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-3fb70a59-4026-48c3-9437-3bc14f47448a admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.070788 Dec 16 15:42:34.753349 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 24/49] 10.222.0.31 () {60 vars in 1193 bytes} [Thu Dec 16 15:42:34 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 16 15:42:34.763333 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-49f6e7fa-9717-4f60-ab35-2677b4a66e6c admin admin] Calling method '>' {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:42:34.777323 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-49f6e7fa-9717-4f60-ab35-2677b4a66e6c admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017595 Dec 16 15:42:34.777920 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 26/50] 10.222.0.31 () {60 vars in 1210 bytes} [Thu Dec 16 15:42:34 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:42:34.793347 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-43185a2b-6fce-47c2-a5d9-82114d50805a admin admin] Calling method '>' {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:42:34.808872 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-43185a2b-6fce-47c2-a5d9-82114d50805a admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023731 Dec 16 15:42:34.809420 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 25/51] 10.222.0.31 () {60 vars in 1210 bytes} [Thu Dec 16 15:42:34 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:42:34.819661 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-6a6c9c2b-0cf6-49f6-9357-24964434a653 admin admin] Calling method '>' {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:42:34.825605 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.wsgi [None req-6a6c9c2b-0cf6-49f6-9357-24964434a653 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 16 15:42:34.825919 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-6a6c9c2b-0cf6-49f6-9357-24964434a653 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:42:34.826755 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-6a6c9c2b-0cf6-49f6-9357-24964434a653 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010775 Dec 16 15:42:34.827251 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 27/52] 10.222.0.31 () {60 vars in 1193 bytes} [Thu Dec 16 15:42:34 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 16 15:42:36.301971 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-43185a2b-6fce-47c2-a5d9-82114d50805a admin admin] Calling method '>' {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:42:36.303023 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-43185a2b-6fce-47c2-a5d9-82114d50805a admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Dec 16 15:42:36.303402 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 26/53] 10.222.0.31 () {56 vars in 1074 bytes} [Thu Dec 16 15:42:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:42:36.505048 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-6567f3de-f89f-47a9-a1ee-3d3cb4f77551 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:42:36.527576 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-6567f3de-f89f-47a9-a1ee-3d3cb4f77551 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.086668 Dec 16 15:42:36.528101 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 28/54] 10.222.0.31 () {64 vars in 1235 bytes} [Thu Dec 16 15:42:36 2021] POST /compute/v2.1/flavors => generated 404 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:42:38.009595 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-43185a2b-6fce-47c2-a5d9-82114d50805a admin admin] Calling method '>' {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:42:38.010601 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-43185a2b-6fce-47c2-a5d9-82114d50805a admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Dec 16 15:42:38.010972 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 27/55] 10.222.0.31 () {56 vars in 1074 bytes} [Thu Dec 16 15:42:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:42:38.210370 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-a0cc71e0-5ae7-41ea-b5b0-b4b0dd553481 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:42:38.231747 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-a0cc71e0-5ae7-41ea-b5b0-b4b0dd553481 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.081124 Dec 16 15:42:38.232223 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 29/56] 10.222.0.31 () {64 vars in 1235 bytes} [Thu Dec 16 15:42:38 2021] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:42:39.721093 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-43185a2b-6fce-47c2-a5d9-82114d50805a admin admin] Calling method '>' {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:42:39.722300 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-43185a2b-6fce-47c2-a5d9-82114d50805a admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001973 Dec 16 15:42:39.722840 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 28/57] 10.222.0.31 () {56 vars in 1074 bytes} [Thu Dec 16 15:42:39 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:42:39.922089 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-eff66837-279c-4524-9e00-8d5eb48aac4e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:42:39.941964 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-eff66837-279c-4524-9e00-8d5eb48aac4e admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.071100 Dec 16 15:42:39.942506 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 30/58] 10.222.0.31 () {64 vars in 1235 bytes} [Thu Dec 16 15:42:39 2021] POST /compute/v2.1/flavors => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:42:41.419027 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-43185a2b-6fce-47c2-a5d9-82114d50805a admin admin] Calling method '>' {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:42:41.420152 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-43185a2b-6fce-47c2-a5d9-82114d50805a admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Dec 16 15:42:41.420545 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 29/59] 10.222.0.31 () {56 vars in 1074 bytes} [Thu Dec 16 15:42:41 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:42:41.619450 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-f7df23d1-bbe6-454f-aec8-066b930f48b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:42:41.644568 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-f7df23d1-bbe6-454f-aec8-066b930f48b6 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.085224 Dec 16 15:42:41.645237 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 31/60] 10.222.0.31 () {64 vars in 1235 bytes} [Thu Dec 16 15:42:41 2021] POST /compute/v2.1/flavors => generated 409 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:42:43.128720 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-43185a2b-6fce-47c2-a5d9-82114d50805a admin admin] Calling method '>' {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:42:43.129788 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-43185a2b-6fce-47c2-a5d9-82114d50805a admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Dec 16 15:42:43.130185 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 30/61] 10.222.0.31 () {56 vars in 1074 bytes} [Thu Dec 16 15:42:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:42:43.341193 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-5228bff0-2961-4da2-8cc8-4c02642232ba admin admin] Calling method '>' {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:42:43.361469 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-5228bff0-2961-4da2-8cc8-4c02642232ba admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.088280 Dec 16 15:42:43.362029 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 32/62] 10.222.0.31 () {60 vars in 1202 bytes} [Thu Dec 16 15:42:43 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:43:31.003843 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-43185a2b-6fce-47c2-a5d9-82114d50805a admin admin] Calling method '>' {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:43:31.005330 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-43185a2b-6fce-47c2-a5d9-82114d50805a admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002091 Dec 16 15:43:31.005911 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 31/63] 10.222.0.31 () {54 vars in 930 bytes} [Thu Dec 16 15:43:31 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:43:31.073537 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-e2a9cbfd-88e6-40ca-90df-3986e8ad1f87 admin admin] Calling method '>' {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:43:31.092862 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-e2a9cbfd-88e6-40ca-90df-3986e8ad1f87 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.077317 Dec 16 15:43:31.093433 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 33/64] 10.222.0.31 () {60 vars in 1291 bytes} [Thu Dec 16 15:43:31 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:43:31.118263 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-0981cd38-7cd9-401a-aff4-b622d0c229f3 admin admin] Calling method '>' {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:43:31.127992 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-0981cd38-7cd9-401a-aff4-b622d0c229f3 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015395 Dec 16 15:43:31.128485 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 32/65] 10.222.0.31 () {60 vars in 1282 bytes} [Thu Dec 16 15:43:31 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:43:31.140570 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-0073c67a-c4d8-4047-887c-e51fd3d61746 admin admin] Calling method '>' {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:43:31.148307 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-0073c67a-c4d8-4047-887c-e51fd3d61746 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011303 Dec 16 15:43:31.148811 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 34/66] 10.222.0.31 () {60 vars in 1285 bytes} [Thu Dec 16 15:43:31 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:43:31.160567 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-927d9782-6a06-4ba4-9c97-36297d006800 admin admin] Calling method '>' {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:43:31.168500 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-927d9782-6a06-4ba4-9c97-36297d006800 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011395 Dec 16 15:43:31.169143 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 33/67] 10.222.0.31 () {60 vars in 1285 bytes} [Thu Dec 16 15:43:31 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:43:31.181377 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-30e60997-aecc-415e-8634-a4f6803b91ba admin admin] Calling method '>' {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:43:31.189445 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-30e60997-aecc-415e-8634-a4f6803b91ba admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011674 Dec 16 15:43:31.189989 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 35/68] 10.222.0.31 () {60 vars in 1282 bytes} [Thu Dec 16 15:43:31 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:45:13.671042 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-5e9452b2-76e0-4541-a88a-34993a0e830b tempest-verify_tempest_config-999710940 tempest-verify_tempest_config-999710940-project] Calling method '>' {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:45:13.672995 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-5e9452b2-76e0-4541-a88a-34993a0e830b tempest-verify_tempest_config-999710940 tempest-verify_tempest_config-999710940-project] 10.222.0.31 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.114281 Dec 16 15:45:13.673522 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 34/69] 10.222.0.31 () {58 vars in 1133 bytes} [Thu Dec 16 15:45:13 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:46:43.219263 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-30e60997-aecc-415e-8634-a4f6803b91ba admin admin] Calling method '>' {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:46:43.220431 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-30e60997-aecc-415e-8634-a4f6803b91ba admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001576 Dec 16 15:46:43.220826 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 36/70] 10.222.0.31 () {56 vars in 1074 bytes} [Thu Dec 16 15:46:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:46:43.498628 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-fcf09633-628b-4af6-b253-b0f661e17da5 admin admin] Calling method '>' {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:46:43.499807 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:46:43.499807 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: warnings.warn(msg) Dec 16 15:46:43.501477 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG oslo_concurrency.lockutils [None req-fcf09633-628b-4af6-b253-b0f661e17da5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:46:43.501910 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG oslo_concurrency.lockutils [None req-fcf09633-628b-4af6-b253-b0f661e17da5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:46:43.502700 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG oslo_concurrency.lockutils [None req-fcf09633-628b-4af6-b253-b0f661e17da5 admin admin] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:46:43.503121 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG oslo_concurrency.lockutils [None req-fcf09633-628b-4af6-b253-b0f661e17da5 admin admin] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:46:43.535324 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-fcf09633-628b-4af6-b253-b0f661e17da5 admin admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.173511 Dec 16 15:46:43.535918 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 35/71] 10.222.0.31 () {60 vars in 1193 bytes} [Thu Dec 16 15:46:43 2021] GET /compute/v2.1/os-services => generated 794 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:46:45.020042 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-30e60997-aecc-415e-8634-a4f6803b91ba admin admin] Calling method '>' {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:46:45.021006 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-30e60997-aecc-415e-8634-a4f6803b91ba admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Dec 16 15:46:45.021394 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 37/72] 10.222.0.31 () {56 vars in 1074 bytes} [Thu Dec 16 15:46:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:46:45.231251 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-b1391931-afea-4697-8ecf-519441008ce7 admin admin] Calling method '>' {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:46:45.232415 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:46:45.232415 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: warnings.warn(msg) Dec 16 15:46:45.233981 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG oslo_concurrency.lockutils [None req-b1391931-afea-4697-8ecf-519441008ce7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:46:45.234434 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG oslo_concurrency.lockutils [None req-b1391931-afea-4697-8ecf-519441008ce7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:46:45.235336 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG oslo_concurrency.lockutils [None req-b1391931-afea-4697-8ecf-519441008ce7 admin admin] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:46:45.235771 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG oslo_concurrency.lockutils [None req-b1391931-afea-4697-8ecf-519441008ce7 admin admin] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:46:45.259877 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-b1391931-afea-4697-8ecf-519441008ce7 admin admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.088527 Dec 16 15:46:45.260428 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 36/73] 10.222.0.31 () {60 vars in 1193 bytes} [Thu Dec 16 15:46:45 2021] GET /compute/v2.1/os-services => generated 1014 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:46:57.175974 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-30e60997-aecc-415e-8634-a4f6803b91ba admin admin] Calling method '>' {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:46:57.177010 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-30e60997-aecc-415e-8634-a4f6803b91ba admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Dec 16 15:46:57.177399 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 38/74] 10.222.0.31 () {56 vars in 1074 bytes} [Thu Dec 16 15:46:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:46:57.382522 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-9481af63-f891-4aea-ba3c-e38ec394c175 admin admin] Calling method '>' {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:46:57.383650 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:46:57.383650 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: warnings.warn(msg) Dec 16 15:46:57.385162 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG oslo_concurrency.lockutils [None req-9481af63-f891-4aea-ba3c-e38ec394c175 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:46:57.385648 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG oslo_concurrency.lockutils [None req-9481af63-f891-4aea-ba3c-e38ec394c175 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:46:57.386467 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG oslo_concurrency.lockutils [None req-9481af63-f891-4aea-ba3c-e38ec394c175 admin admin] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:46:57.386896 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG oslo_concurrency.lockutils [None req-9481af63-f891-4aea-ba3c-e38ec394c175 admin admin] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:46:57.407641 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-9481af63-f891-4aea-ba3c-e38ec394c175 admin admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.088671 Dec 16 15:46:57.408175 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 37/75] 10.222.0.31 () {60 vars in 1193 bytes} [Thu Dec 16 15:46:57 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:46:58.914185 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: DEBUG nova.api.openstack.wsgi [None req-30e60997-aecc-415e-8634-a4f6803b91ba admin admin] Calling method '>' {{(pid=108179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:46:58.915193 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: INFO nova.api.openstack.requestlog [None req-30e60997-aecc-415e-8634-a4f6803b91ba admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Dec 16 15:46:58.915583 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: [pid: 108179|app: 0|req: 39/76] 10.222.0.31 () {56 vars in 1074 bytes} [Thu Dec 16 15:46:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:46:59.126394 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG nova.api.openstack.wsgi [None req-a3273d33-5abd-4695-b119-628e4709cee7 admin admin] Calling method '>' {{(pid=108178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:46:59.127658 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:46:59.127658 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: warnings.warn(msg) Dec 16 15:46:59.129208 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG oslo_concurrency.lockutils [None req-a3273d33-5abd-4695-b119-628e4709cee7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:46:59.129682 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG oslo_concurrency.lockutils [None req-a3273d33-5abd-4695-b119-628e4709cee7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:46:59.130489 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG oslo_concurrency.lockutils [None req-a3273d33-5abd-4695-b119-628e4709cee7 admin admin] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:46:59.130922 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: DEBUG oslo_concurrency.lockutils [None req-a3273d33-5abd-4695-b119-628e4709cee7 admin admin] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:46:59.151838 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: INFO nova.api.openstack.requestlog [None req-a3273d33-5abd-4695-b119-628e4709cee7 admin admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.090632 Dec 16 15:46:59.152422 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: [pid: 108178|app: 0|req: 38/77] 10.222.0.31 () {60 vars in 1193 bytes} [Thu Dec 16 15:46:59 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:47:58.255156 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: Thu Dec 16 15:47:58 2021 - graceful shutdown triggered... Dec 16 15:47:58.255689 dv-cinder-784477-11-iscsi devstack@n-api.service[108179]: Gracefully killing worker 2 (pid: 108179)... Dec 16 15:47:58.255289 dv-cinder-784477-11-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 16 15:47:58.256469 dv-cinder-784477-11-iscsi devstack@n-api.service[108178]: Gracefully killing worker 1 (pid: 108178)... Dec 16 15:47:59.256574 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: worker 1 buried after 1 seconds Dec 16 15:47:59.256574 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: worker 2 buried after 1 seconds Dec 16 15:47:59.256574 dv-cinder-784477-11-iscsi devstack@n-api.service[108177]: goodbye to uWSGI. Dec 16 15:47:59.258888 dv-cinder-784477-11-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 16 15:47:59.259802 dv-cinder-784477-11-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 16 15:47:59.264289 dv-cinder-784477-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 16 15:47:59.280770 dv-cinder-784477-11-iscsi devstack@n-api.service[122379]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 16 15:47:59.283084 dv-cinder-784477-11-iscsi devstack@n-api.service[122379]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Dec 16 15:47:59 2021] *** Dec 16 15:47:59.283084 dv-cinder-784477-11-iscsi devstack@n-api.service[122379]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 16 15:47:59.283084 dv-cinder-784477-11-iscsi devstack@n-api.service[122379]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 16 15:47:59.283084 dv-cinder-784477-11-iscsi devstack@n-api.service[122379]: nodename: dv-cinder-784477-11-iscsi Dec 16 15:47:59.283084 dv-cinder-784477-11-iscsi devstack@n-api.service[122379]: machine: x86_64 Dec 16 15:47:59.283084 dv-cinder-784477-11-iscsi devstack@n-api.service[122379]: clock source: unix Dec 16 15:47:59.283084 dv-cinder-784477-11-iscsi devstack@n-api.service[122379]: pcre jit disabled Dec 16 15:47:59.283084 dv-cinder-784477-11-iscsi devstack@n-api.service[122379]: detected number of CPU cores: 4 Dec 16 15:47:59.283084 dv-cinder-784477-11-iscsi devstack@n-api.service[122379]: current working directory: / Dec 16 15:47:59.283084 dv-cinder-784477-11-iscsi devstack@n-api.service[122379]: detected binary path: /usr/bin/uwsgi-core Dec 16 15:47:59.283734 dv-cinder-784477-11-iscsi devstack@n-api.service[122379]: your processes number limit is 47680 Dec 16 15:47:59.283734 dv-cinder-784477-11-iscsi devstack@n-api.service[122379]: your memory page size is 4096 bytes Dec 16 15:47:59.283734 dv-cinder-784477-11-iscsi devstack@n-api.service[122379]: detected max file descriptor number: 2048 Dec 16 15:47:59.283734 dv-cinder-784477-11-iscsi devstack@n-api.service[122379]: lock engine: pthread robust mutexes Dec 16 15:47:59.283734 dv-cinder-784477-11-iscsi devstack@n-api.service[122379]: thunder lock: enabled Dec 16 15:47:59.283734 dv-cinder-784477-11-iscsi devstack@n-api.service[122379]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 16 15:47:59.283734 dv-cinder-784477-11-iscsi devstack@n-api.service[122379]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 16 15:47:59.328293 dv-cinder-784477-11-iscsi devstack@n-api.service[122379]: Python main interpreter initialized at 0x5654d83bb9c0 Dec 16 15:47:59.328293 dv-cinder-784477-11-iscsi devstack@n-api.service[122379]: python threads support enabled Dec 16 15:47:59.328293 dv-cinder-784477-11-iscsi devstack@n-api.service[122379]: your server socket listen backlog is limited to 100 connections Dec 16 15:47:59.328293 dv-cinder-784477-11-iscsi devstack@n-api.service[122379]: your mercy for graceful operations on workers is 90 seconds Dec 16 15:47:59.328730 dv-cinder-784477-11-iscsi devstack@n-api.service[122379]: mapped 403077 bytes (393 KB) for 2 cores Dec 16 15:47:59.328730 dv-cinder-784477-11-iscsi devstack@n-api.service[122379]: *** Operational MODE: preforking *** Dec 16 15:47:59.329013 dv-cinder-784477-11-iscsi devstack@n-api.service[122379]: *** uWSGI is running in multiple interpreter mode *** Dec 16 15:47:59.329013 dv-cinder-784477-11-iscsi devstack@n-api.service[122379]: spawned uWSGI master process (pid: 122379) Dec 16 15:47:59.329285 dv-cinder-784477-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 16 15:47:59.329886 dv-cinder-784477-11-iscsi devstack@n-api.service[122379]: spawned uWSGI worker 1 (pid: 122398, cores: 1) Dec 16 15:47:59.330191 dv-cinder-784477-11-iscsi devstack@n-api.service[122379]: spawned uWSGI worker 2 (pid: 122399, cores: 1) Dec 16 15:47:59.330495 dv-cinder-784477-11-iscsi devstack@n-api.service[122379]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 16 15:48:01.204959 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 16 15:48:01.204959 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: from cryptography.utils import int_from_bytes Dec 16 15:48:01.205690 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 16 15:48:01.205690 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: from cryptography.utils import int_from_bytes Dec 16 15:48:01.224431 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 16 15:48:01.224431 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: from cryptography.utils import int_from_bytes Dec 16 15:48:01.225023 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 16 15:48:01.225023 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: from cryptography.utils import int_from_bytes Dec 16 15:48:03.600783 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 16 15:48:03.601750 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 16 15:48:03.602251 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 16 15:48:03.602702 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 16 15:48:03.602848 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 16 15:48:03.603236 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.603955 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.604298 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.604626 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.604961 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.605304 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.605653 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.605979 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.606310 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.606545 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.606889 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.607201 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784477-11-iscsi {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.607527 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.607840 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.608152 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.608473 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.608780 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.609104 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.609430 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.609938 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.611698 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.611698 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.611698 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.611698 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.611698 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.612125 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.612210 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.615876 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.615876 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.615876 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.615876 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784477-11-iscsi {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.615876 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.615876 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.615876 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.616440 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 16 15:48:03.616440 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 16 15:48:03.616940 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.616940 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.617100 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 16 15:48:03.617185 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.617548 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 16 15:48:03.617718 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.617865 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 16 15:48:03.618018 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.618168 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.618318 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.618493 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.618646 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.618791 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.618945 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.619126 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.619321 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.619477 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.619654 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.619809 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.619952 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.620093 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.620246 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.620912 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.621073 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.621237 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.621381 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.621572 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.621724 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.621916 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.622190 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.622467 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784477-11-iscsi {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.622733 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.622997 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.623257 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.623497 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.623827 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.624169 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.624428 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.624681 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.624939 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.625211 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.625503 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.625503 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.626025 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.626298 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.626574 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.626840 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.627142 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.627551 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.627970 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.628338 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.628707 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.629083 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.629601 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.629964 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.630223 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.630598 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.631004 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.631271 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.631682 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.631975 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.632223 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.632487 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.632757 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.633115 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.633482 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.633778 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.634046 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.634293 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.634293 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.635703 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784477-11-iscsi {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.638902 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.639185 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.639185 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.639621 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.31 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.639803 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.640061 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.31 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.640061 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.641197 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.641367 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.641564 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.641842 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.642007 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.642151 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.642294 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.642445 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.642596 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.642746 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.642908 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.643059 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.643233 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.643385 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.643563 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.643727 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.643869 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.644028 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.644173 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.644341 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.644498 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.644646 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.644795 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.644937 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.645106 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.645271 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.645467 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.645630 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.645790 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.645948 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.646103 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.646265 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.646414 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.646556 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.646705 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.646855 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.646996 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.647158 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.647311 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.647460 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.647610 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.647762 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.647914 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.648064 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.648214 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.648371 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.648521 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.648677 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.649105 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.649388 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.649594 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.649828 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.649994 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.650239 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.650402 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.650598 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.650741 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.650994 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.651144 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.651423 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.651576 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.651730 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.651991 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.652140 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.652282 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.652440 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.652591 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.652741 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.652884 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.653039 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.653183 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.653324 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.653505 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.653650 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.653826 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.653975 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.653975 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.654262 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.31 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.654262 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.31 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.654553 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.654707 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.654858 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.655146 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.655297 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.655440 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.655596 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.655747 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.655910 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.655910 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.656196 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.656341 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.656492 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.656636 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.656776 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.656927 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.657659 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.657832 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.657978 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.658128 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.658279 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.658441 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.658584 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.658740 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.658882 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.659246 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.659491 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.659641 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.659867 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.660037 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.660191 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.660431 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.660573 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.660724 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.660877 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.661121 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.661278 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.661543 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.661703 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.661856 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.662014 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.662156 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.662305 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.662454 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.662609 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.662874 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.663038 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.663038 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.663332 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.663477 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.663666 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.663825 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.663980 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.664130 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.664283 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.664428 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.664569 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.664728 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.664920 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.665081 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.665328 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.665515 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.665670 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.665823 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.665977 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.666119 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.666277 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.666431 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.666589 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.666738 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.666880 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.667031 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.667190 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.667332 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.667472 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.667624 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.667766 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.667923 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.668066 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.668208 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.668357 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.668505 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.668647 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.668801 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.669108 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.669351 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.669680 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.669852 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.670082 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.670246 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.670493 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.670656 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.670807 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.670953 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.671186 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.671357 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.671620 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.671807 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.671966 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.672124 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.672124 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.672583 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.672734 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.673003 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.673152 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.673301 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.673500 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.673698 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.673852 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.674015 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.674174 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.674321 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.674480 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.674623 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.674775 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.674925 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.675077 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.675329 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.675491 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.675655 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.675821 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.675968 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.676113 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.676283 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.676443 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 15:48:03.676600 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.676751 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.676902 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.677053 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.677205 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.677205 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.677528 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.677688 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.677844 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.678003 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.678169 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.678325 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.678475 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.678626 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.678781 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.678936 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.679094 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.679449 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.679614 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.679857 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.680014 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.680261 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.680410 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.680674 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.680830 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.680978 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.681126 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.681420 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.681631 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.681885 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.682039 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.682199 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.682349 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.682492 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.682644 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.682789 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.683060 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.683219 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.683373 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.683523 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.683675 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.684332 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.684504 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.684651 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.684792 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.684945 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.684945 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.685236 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.685539 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.685688 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.685838 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.685992 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.686148 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.686292 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.686532 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.686688 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.686839 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.686996 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.687147 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.687289 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.687429 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.687580 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.687730 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.687881 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.688035 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.688184 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.688333 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.688482 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.688625 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.688775 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.688917 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.689066 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.689216 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.689461 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.689697 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.689924 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.690081 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.690243 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.690453 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.690600 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.690875 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.691034 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.691179 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.691346 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.691567 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.691713 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.691876 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.692019 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.692162 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.692311 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.692461 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.692711 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.692869 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.693219 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.693378 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.693563 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.693717 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.693879 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.694031 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.694183 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.694334 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.694483 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.694633 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.694784 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.694926 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.695066 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.695209 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.695351 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.695351 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.695351 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.695852 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.695995 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.696154 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.696307 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.696451 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.696601 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.696754 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.696925 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.696925 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.697306 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.697487 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.697644 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.697788 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.697929 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.698077 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.698231 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.698459 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.698612 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.698755 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.698897 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.699047 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.699198 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.699357 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.699592 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.699825 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.700058 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.700207 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.700349 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.700591 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.700749 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.700984 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.701140 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.701284 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.701462 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.701692 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.701839 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.701988 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.702138 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.702288 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.702443 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.702605 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.702850 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.702999 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.703142 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.703466 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.703621 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.703766 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.703766 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.704042 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.704185 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.704325 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.704479 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.704630 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.704783 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.704924 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.705073 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.705225 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.705374 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.705575 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.705743 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.705957 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.706108 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.706332 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.706487 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.706640 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.706794 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.706954 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.707103 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.707255 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.707408 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.707561 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.707710 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.707859 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.708003 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.708162 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.708310 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.708457 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.708600 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.708742 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.708893 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.709045 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.709197 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.709348 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.709527 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.709760 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.709993 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.710220 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.710374 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.710524 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.710759 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.710909 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.711150 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.711318 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.711468 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.711621 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.711845 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.711993 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.712147 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.712298 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.712441 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.712591 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.712733 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.713016 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.713178 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.713334 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.713645 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.713799 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.713949 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.714102 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.714253 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.714400 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.714541 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.714690 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.714831 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.714981 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.714981 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.715267 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.715267 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.715564 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.715714 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.715865 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.716085 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.716238 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.716380 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.716529 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.716678 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.716830 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.716980 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.717121 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.717262 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.717462 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.717634 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.717786 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.717928 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.718068 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.718209 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.718349 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.718505 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.718647 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.718788 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.718936 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.719090 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.719247 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.719421 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.719577 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.719745 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.719980 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.720211 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.720438 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.720602 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.720780 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.721012 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.721262 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.721442 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.721619 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.721778 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.722025 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.722179 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.722335 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.722484 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.722646 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.722812 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.722971 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.723229 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.723384 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.723533 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.723796 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.723959 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.724119 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.724276 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.724425 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.724581 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.724746 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.724902 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.725051 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.725209 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.725357 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.725545 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.725714 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.725866 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.726022 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.726272 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.726272 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.726576 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.726733 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.726884 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.727041 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.727190 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.727346 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.727632 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.727841 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.728966 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.729149 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.729309 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.729567 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.729732 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.729890 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.730533 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.730715 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.730869 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.731036 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.731382 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.731541 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.731703 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.731861 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.732052 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.732295 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.732449 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.732598 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.732762 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.732921 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.733079 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.733248 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.733543 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.733714 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.733989 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.734154 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.734313 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.734484 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.734641 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.734806 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.734957 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.735105 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.735259 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.735415 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.735564 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.735727 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.735891 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.736043 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.736203 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.736473 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.736629 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.736785 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.736935 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.737083 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.737313 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.737486 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.737641 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.737827 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.737982 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.738143 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.738304 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.738462 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.738623 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.738779 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.738926 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.739077 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.739234 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.739385 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.739533 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.739690 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.739839 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.739987 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.740162 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.740398 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.740722 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.740897 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.741047 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.741205 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.741531 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.741531 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.741823 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.741971 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.742118 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.742296 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.742526 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.742692 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.742852 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.743224 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.743399 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.743524 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.743605 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.743605 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.743605 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.743832 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.743928 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.744393 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.744493 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.744581 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.744665 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.744757 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.744853 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.744940 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.745034 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.745127 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.745213 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.745298 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.745397 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.745523 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.745616 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.745713 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.745800 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.745893 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.745988 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.746074 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.746162 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.746254 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.746344 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.746464 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.746615 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.746708 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.746795 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.746901 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.746989 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.747081 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.747172 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.747258 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.747343 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.747435 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.747528 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.747612 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.747703 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.747797 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.747883 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.747977 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.748063 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.748156 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.748241 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.748334 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.748434 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.748522 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.748607 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.748692 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.748792 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.748883 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.748978 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.749073 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.749175 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.749262 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.749355 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.749476 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.749573 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.749660 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.749823 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.749920 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.750013 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.750105 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.750201 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.750303 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.750411 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.750500 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.750585 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.750856 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.750951 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.751046 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.751133 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.751225 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.751310 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.751404 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.751523 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.751614 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.751707 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.751800 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.751886 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.751982 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.752068 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.752161 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.752261 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.752346 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.752430 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.752686 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.752782 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.752877 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.752964 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.753057 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.753155 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.753322 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.753552 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.753656 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.753758 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.753844 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.753938 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.754033 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.754119 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.754208 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.754291 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.754291 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.754291 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.754291 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.754685 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.754772 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.754864 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.754951 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.755048 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.755134 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.755134 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.755290 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.755374 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.755474 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.755561 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.755653 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.755746 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.755832 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.755922 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.756014 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.756112 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.756204 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.756289 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.756371 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.756531 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.756635 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.756723 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.756820 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.756913 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.756999 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.757089 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.757187 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.757280 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.757365 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.757467 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.757541 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.757708 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.757804 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.757890 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.757890 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.758051 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.758136 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.758236 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.758322 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.758414 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.758513 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.758598 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.758689 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.758689 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.758861 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.758954 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.759040 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.759123 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.759206 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.759300 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.759385 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.759478 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.759639 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.759748 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.759851 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.759937 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.760020 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.760103 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.760196 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.760281 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.760377 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.760465 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.760557 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.760649 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.760741 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.761002 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.761109 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.761197 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.761288 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.761373 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.761473 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.761559 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.761662 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.761762 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.761891 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.761994 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.762088 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.762184 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.762281 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.762376 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.762471 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.762559 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.762796 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.762904 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.762991 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.763153 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.763153 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.763311 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.763395 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.763491 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.763577 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.763668 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.763762 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.763846 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.763932 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.764039 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.764132 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.764232 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.764324 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.764410 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.764537 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.764639 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.764733 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.764819 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.764941 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.765068 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.765175 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.765262 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.765363 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.765515 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.765602 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.765765 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.765901 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.766027 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.766148 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.766261 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.766373 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.766492 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.766692 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.766814 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.766925 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.767050 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.767161 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.767272 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.767406 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.767533 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.767652 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.767762 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.767872 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.767991 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.768102 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.768102 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.768320 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.768440 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.768560 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.768681 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.768793 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.768903 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.769071 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.769183 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.769293 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.769436 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.769554 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.769664 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.769774 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.769896 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.770017 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.770155 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.770244 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.770330 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.770414 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.770567 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.770663 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.770749 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.770840 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.770939 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.771240 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.771374 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.771483 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.771571 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.771663 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.771757 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.771757 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.771757 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.771987 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.772119 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.772220 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.772314 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.772406 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.772509 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.772617 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.772941 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.773053 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.773141 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.773141 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.773320 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.773423 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.773512 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.773601 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.773676 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.773754 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.773847 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.773927 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.774013 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.774085 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.774157 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.774227 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.774311 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.774384 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.774454 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.774454 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.774588 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.774668 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.774741 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.774818 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.774889 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.774959 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.775037 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.775125 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.775198 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.775276 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.775442 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.775524 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.775596 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.775695 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.775829 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.775920 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.776001 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.776001 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.776155 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.776155 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.776155 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.776155 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.776155 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.776531 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.776659 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.776752 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.776838 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.776838 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.776999 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.777093 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.777179 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.777265 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.777356 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.777471 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.777559 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.777652 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.777751 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.777843 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.777934 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.778019 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.778111 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.778203 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.778289 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.778374 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.778470 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.778555 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.778656 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.778749 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.778749 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.778914 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.779001 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.779101 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.779200 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.779294 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.779388 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.779481 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.779573 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.779671 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.779757 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.779848 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.779933 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.780058 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.780150 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.780247 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.780336 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.780428 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.780513 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.780604 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.780690 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.780782 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.780875 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.780961 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.781061 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.781162 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.781414 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.781529 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.781618 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.781717 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.781817 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.781904 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.781988 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.782081 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.782215 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.782307 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.782399 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.782491 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.782590 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.782682 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.782772 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.782857 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.783012 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.783160 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.783267 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.783365 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.783451 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.783543 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.783636 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.783721 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.783814 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.783900 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.783993 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.784085 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.784325 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.784670 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.784879 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.785014 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.785233 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.785326 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.785595 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.785709 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.785939 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.786033 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.786273 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.786363 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.786602 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.786707 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.786932 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.787026 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.787255 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.787349 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.787571 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.787685 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.787890 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.788008 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.788205 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.788342 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.788518 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.788625 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.788831 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.788929 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.789149 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.789247 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.790044 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.790218 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.790311 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.790311 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.790473 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.790565 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.790660 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.790746 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.790833 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.791054 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.791150 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.791381 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.791541 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.791707 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.791811 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.792019 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.792123 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.792340 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.792451 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.792670 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.792763 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.793051 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.793185 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.793285 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.793372 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.793685 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.793779 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.793971 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.794070 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.794306 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.794424 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.794643 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.794797 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.794973 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.795107 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.795296 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.795465 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.795613 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.795758 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.795906 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.796072 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.796250 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.796396 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.796577 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.796726 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.796902 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.797046 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.797224 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.797379 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.797737 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.797891 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.798036 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.798139 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.798363 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.798500 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.798685 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.798803 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.799007 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.799307 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.799432 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.799664 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.799782 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.799992 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.800119 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.800307 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.800421 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.800627 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.800746 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.800965 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.801097 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.801346 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.801631 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.801778 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.802021 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.802219 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.802345 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.802467 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.802578 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.802688 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.802876 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.803116 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.803251 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.803525 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.803875 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.804086 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.804199 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.804467 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.804567 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.804819 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.804918 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.805143 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.805279 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.805545 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.805668 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.805871 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.805996 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.806190 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.806296 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.806509 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.806647 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.806885 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.806979 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.807208 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.807311 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.807531 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.807631 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.807845 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.807938 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.808162 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.808260 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.808486 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.808587 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.808802 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.808914 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.809116 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.809217 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.809477 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.809592 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.809781 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.809890 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.810111 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.810404 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.810498 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.810764 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.810863 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.811085 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.811177 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.811418 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.811517 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.811730 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.811842 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.812050 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.812269 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.812369 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.812591 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.812695 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.812928 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.813099 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.813298 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.813465 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.813630 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.813986 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.814265 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.814602 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.814862 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.815005 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.815308 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.815454 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.815595 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.815843 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.815972 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.816164 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.816451 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.816768 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.816983 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.817126 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.818143 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.818279 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.818427 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.818566 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.818695 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.818695 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.818949 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.819084 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.819223 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.819353 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.819481 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.819618 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.819747 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.819886 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.820080 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.820222 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.820401 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.820548 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.820729 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.820844 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.821046 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.821140 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.821363 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.821485 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.821820 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.822048 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.822048 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.822338 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.822467 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.822557 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.822705 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.822807 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.822959 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.823060 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.823271 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.823365 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.823581 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.823702 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.823894 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.824024 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.824198 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.824332 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.824518 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.824630 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.824828 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.824926 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.825141 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.825244 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.825480 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.825577 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.825795 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.825904 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.826122 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.826237 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.826444 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.826546 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.826750 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.826856 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.827071 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.827170 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.827382 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.827488 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.827697 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.827810 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.828007 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.828149 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.828341 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.828602 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.828696 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.828956 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.829119 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.829263 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.829355 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.829622 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.829733 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.829933 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.830059 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.830242 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.830379 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.830571 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.830696 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.830887 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.831013 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.831213 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.831349 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.831534 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.831682 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.831906 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.832044 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.832200 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.832304 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.832528 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.832622 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.832928 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.833071 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.833249 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.833490 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.833590 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.833820 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.833931 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.834204 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.834326 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.834504 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.834606 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.834817 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.834920 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.835131 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.835244 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.835439 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.835532 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.835770 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.835877 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.836089 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.836196 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.836412 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.836540 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.836728 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.836836 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.837043 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.837145 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.837356 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.837499 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.837712 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.837896 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.838085 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.838181 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.838405 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.838502 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.838719 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.838820 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.839036 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.839159 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.839385 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.839487 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.839712 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.839812 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.840035 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.840140 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.840359 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.840524 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.840688 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.840871 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.840998 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.841200 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.841319 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.841552 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.841648 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.841886 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.841991 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.842209 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.842323 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.842544 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.842638 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.842894 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.842993 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.843202 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.843306 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.843559 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.843651 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.843871 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.843977 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.844188 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.844342 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.844504 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.844620 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.844828 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.844928 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.845170 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.845295 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.845538 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.845657 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.845861 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.845955 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.846193 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.846301 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.846504 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.846613 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.846830 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.846930 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.847150 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.847244 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.847478 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.847579 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.847806 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.847899 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.848119 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.848213 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.848430 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.848532 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.848745 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.848846 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.849061 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.849154 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.849390 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.849535 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.849741 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.849847 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.850066 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.850160 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.850387 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.850492 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.850704 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.850857 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.851032 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.851134 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.851351 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.851443 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.851661 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.851839 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.851997 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.852215 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.852431 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.852576 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.852726 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.852875 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.853016 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.853145 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.853238 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.853756 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.853982 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.854076 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.854320 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.854498 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.854639 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.854772 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.854945 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.855056 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.855259 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.855359 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.855600 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.855711 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.855936 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.856093 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.856244 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.856400 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.856568 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.856738 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.856890 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.857195 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.857547 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.857773 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.857885 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.858160 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.858263 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.858505 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.858606 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.858835 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.858950 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.859158 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.859251 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.859479 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.859609 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.859810 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.859956 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.860143 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.860296 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.860474 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.860620 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.860808 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.860916 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 16 15:48:03.861141 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.861502 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.861856 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.862179 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.862554 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.862873 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.863196 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.863519 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.863840 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 15:48:03.864091 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 16 15:48:03.885965 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_db.sqlalchemy.engines [None req-38795356-ac37-4733-bcaf-18f9fa8d148c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 16 15:48:03.887079 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_db.sqlalchemy.engines [None req-77e8e3d7-883d-4001-87ac-e7f5c1ec7cb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 16 15:48:03.952033 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.context [None req-38795356-ac37-4733-bcaf-18f9fa8d148c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),23718866-586d-4970-8765-992ef61502a3(cell1) {{(pid=122399) load_cells /opt/stack/nova/nova/context.py:464}} Dec 16 15:48:03.952507 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.context [None req-77e8e3d7-883d-4001-87ac-e7f5c1ec7cb7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),23718866-586d-4970-8765-992ef61502a3(cell1) {{(pid=122398) load_cells /opt/stack/nova/nova/context.py:464}} Dec 16 15:48:03.956619 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-38795356-ac37-4733-bcaf-18f9fa8d148c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:03.956790 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-77e8e3d7-883d-4001-87ac-e7f5c1ec7cb7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:03.958238 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-38795356-ac37-4733-bcaf-18f9fa8d148c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:03.958380 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-77e8e3d7-883d-4001-87ac-e7f5c1ec7cb7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:03.959061 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-38795356-ac37-4733-bcaf-18f9fa8d148c None None] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:03.959216 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-77e8e3d7-883d-4001-87ac-e7f5c1ec7cb7 None None] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:03.960999 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-38795356-ac37-4733-bcaf-18f9fa8d148c None None] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:03.961153 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-77e8e3d7-883d-4001-87ac-e7f5c1ec7cb7 None None] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:03.975611 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_db.sqlalchemy.engines [None req-77e8e3d7-883d-4001-87ac-e7f5c1ec7cb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 16 15:48:03.976978 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_db.sqlalchemy.engines [None req-38795356-ac37-4733-bcaf-18f9fa8d148c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 16 15:48:03.978864 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_db.sqlalchemy.engines [None req-38795356-ac37-4733-bcaf-18f9fa8d148c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 16 15:48:03.979823 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_db.sqlalchemy.engines [None req-77e8e3d7-883d-4001-87ac-e7f5c1ec7cb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 16 15:48:04.140328 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_db.sqlalchemy.engines [None req-77e8e3d7-883d-4001-87ac-e7f5c1ec7cb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 16 15:48:04.143729 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_db.sqlalchemy.engines [None req-38795356-ac37-4733-bcaf-18f9fa8d148c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 16 15:48:04.456190 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: WARNING keystonemiddleware.auth_token [None req-77e8e3d7-883d-4001-87ac-e7f5c1ec7cb7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 15:48:04.462722 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: WARNING keystonemiddleware.auth_token [None req-77e8e3d7-883d-4001-87ac-e7f5c1ec7cb7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 15:48:04.464660 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: WARNING keystonemiddleware.auth_token [None req-38795356-ac37-4733-bcaf-18f9fa8d148c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 15:48:04.471212 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: WARNING keystonemiddleware.auth_token [None req-38795356-ac37-4733-bcaf-18f9fa8d148c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 15:48:04.801087 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: WARNING keystonemiddleware.auth_token [None req-77e8e3d7-883d-4001-87ac-e7f5c1ec7cb7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 15:48:04.806539 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: WARNING keystonemiddleware.auth_token [None req-77e8e3d7-883d-4001-87ac-e7f5c1ec7cb7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 15:48:04.811412 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: WARNING keystonemiddleware.auth_token [None req-38795356-ac37-4733-bcaf-18f9fa8d148c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 15:48:04.811923 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5654d83bb9c0 pid: 122398 (default app) Dec 16 15:48:04.816745 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: WARNING keystonemiddleware.auth_token [None req-38795356-ac37-4733-bcaf-18f9fa8d148c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 15:48:04.822363 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5654d83bb9c0 pid: 122399 (default app) Dec 16 15:48:36.730199 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-97363041-8a65-4568-af14-c079da9dbe53 tempest-VolumesNegativeTest-1933557549 tempest-VolumesNegativeTest-1933557549-project] Action: 'create', calling method: .version_select at 0x7fed5fe6be50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1784982090", "metadata": {"Type": "work"}}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:48:36.731867 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-97363041-8a65-4568-af14-c079da9dbe53 tempest-VolumesNegativeTest-1933557549 tempest-VolumesNegativeTest-1933557549-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:48:36.732773 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-97363041-8a65-4568-af14-c079da9dbe53 tempest-VolumesNegativeTest-1933557549 tempest-VolumesNegativeTest-1933557549-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.011398 Dec 16 15:48:36.733313 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 1/1] 10.222.0.31 () {60 vars in 1155 bytes} [Thu Dec 16 15:48:35 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1014 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 16 15:48:36.951539 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-3619f4b1-3165-41f9-8418-45e7636a144f tempest-VolumesNegativeTest-1933557549 tempest-VolumesNegativeTest-1933557549-project] Action: 'create', calling method: .version_select at 0x7fed5feb9a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-895796504", "metadata": {"Type": "work"}}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:48:36.953248 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-3619f4b1-3165-41f9-8418-45e7636a144f tempest-VolumesNegativeTest-1933557549 tempest-VolumesNegativeTest-1933557549-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:48:36.954203 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-3619f4b1-3165-41f9-8418-45e7636a144f tempest-VolumesNegativeTest-1933557549 tempest-VolumesNegativeTest-1933557549-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.214476 Dec 16 15:48:36.954983 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 1/2] 10.222.0.31 () {60 vars in 1155 bytes} [Thu Dec 16 15:48:36 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 217 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 16 15:48:36.963867 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-f1f64be8-c94d-417e-a7c2-00371bc5205a tempest-VolumesNegativeTest-1933557549 tempest-VolumesNegativeTest-1933557549-project] Action: 'create', calling method: .version_select at 0x7fed5fda09d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1107152131", "metadata": {"Type": "work"}}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:48:36.965022 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-f1f64be8-c94d-417e-a7c2-00371bc5205a tempest-VolumesNegativeTest-1933557549 tempest-VolumesNegativeTest-1933557549-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:48:36.966171 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-f1f64be8-c94d-417e-a7c2-00371bc5205a tempest-VolumesNegativeTest-1933557549 tempest-VolumesNegativeTest-1933557549-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006050 Dec 16 15:48:36.966813 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 2/3] 10.222.0.31 () {60 vars in 1155 bytes} [Thu Dec 16 15:48:36 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 16 15:48:36.975896 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-c7b7a0bd-4e2f-4b17-afe6-3c58d0fc5367 tempest-VolumesNegativeTest-1933557549 tempest-VolumesNegativeTest-1933557549-project] Calling method '.version_select at 0x7fed5fe17670>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:38.071873 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.wsgi [None req-c7b7a0bd-4e2f-4b17-afe6-3c58d0fc5367 tempest-VolumesNegativeTest-1933557549 tempest-VolumesNegativeTest-1933557549-project] HTTP exception thrown: Volume tempest-invalid-1647684560 could not be found. Dec 16 15:48:38.073338 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-c7b7a0bd-4e2f-4b17-afe6-3c58d0fc5367 tempest-VolumesNegativeTest-1933557549 tempest-VolumesNegativeTest-1933557549-project] Returning 404 to user: Volume tempest-invalid-1647684560 could not be found. {{(pid=122399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:48:38.074272 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-c7b7a0bd-4e2f-4b17-afe6-3c58d0fc5367 tempest-VolumesNegativeTest-1933557549 tempest-VolumesNegativeTest-1933557549-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1647684560" status: 404 len: 99 microversion: 2.1 time: 1.102160 Dec 16 15:48:38.079515 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 2/4] 10.222.0.31 () {58 vars in 1217 bytes} [Thu Dec 16 15:48:36 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1647684560 => generated 99 bytes in 1108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Dec 16 15:48:38.087382 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-69c14b24-fdaf-42f6-bd87-0dcbd3b3c639 tempest-VolumesNegativeTest-1933557549 tempest-VolumesNegativeTest-1933557549-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007011 Dec 16 15:48:38.091288 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 3/5] 10.222.0.31 () {58 vars in 1139 bytes} [Thu Dec 16 15:48:38 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 16 15:48:38.101081 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-43e0a1cc-1330-49ab-bafa-971f8699bed8 tempest-VolumesNegativeTest-1933557549 tempest-VolumesNegativeTest-1933557549-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006031 Dec 16 15:48:38.101679 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 3/6] 10.222.0.31 () {58 vars in 1136 bytes} [Thu Dec 16 15:48:38 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 16 15:48:38.113203 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-f598abc7-cdf1-4869-bdea-208152b8a098 tempest-VolumesNegativeTest-1933557549 tempest-VolumesNegativeTest-1933557549-project] Calling method '.version_select at 0x7fed5fe6bf70>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:38.789905 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.wsgi [None req-f598abc7-cdf1-4869-bdea-208152b8a098 tempest-VolumesNegativeTest-1933557549 tempest-VolumesNegativeTest-1933557549-project] HTTP exception thrown: Volume 6dee1c13-0706-4df2-bb12-f1b08b870a75 could not be found. Dec 16 15:48:38.790678 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-f598abc7-cdf1-4869-bdea-208152b8a098 tempest-VolumesNegativeTest-1933557549 tempest-VolumesNegativeTest-1933557549-project] Returning 404 to user: Volume 6dee1c13-0706-4df2-bb12-f1b08b870a75 could not be found. {{(pid=122398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:48:38.791577 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-f598abc7-cdf1-4869-bdea-208152b8a098 tempest-VolumesNegativeTest-1933557549 tempest-VolumesNegativeTest-1933557549-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/6dee1c13-0706-4df2-bb12-f1b08b870a75" status: 404 len: 109 microversion: 2.1 time: 0.683845 Dec 16 15:48:38.792403 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 4/7] 10.222.0.31 () {58 vars in 1247 bytes} [Thu Dec 16 15:48:38 2021] DELETE /compute/v2.1/os-volumes/6dee1c13-0706-4df2-bb12-f1b08b870a75 => generated 109 bytes in 685 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:48:38.804012 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ca049024-3588-4152-bfaf-63b64404c631 tempest-VolumesNegativeTest-1933557549 tempest-VolumesNegativeTest-1933557549-project] Calling method '.version_select at 0x7fed5fd8dee0>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:38.870269 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-f768d5f0-c559-44b9-a117-7955becef5d9 tempest-VolumesTestJSON-1632861882 tempest-VolumesTestJSON-1632861882-project] Calling method '.version_select at 0x7fed5fd46f70>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:38.910457 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.wsgi [None req-ca049024-3588-4152-bfaf-63b64404c631 tempest-VolumesNegativeTest-1933557549 tempest-VolumesNegativeTest-1933557549-project] HTTP exception thrown: Volume e170fc65-02f8-4f10-9fd3-5d3b0d699698 could not be found. Dec 16 15:48:38.911724 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ca049024-3588-4152-bfaf-63b64404c631 tempest-VolumesNegativeTest-1933557549 tempest-VolumesNegativeTest-1933557549-project] Returning 404 to user: Volume e170fc65-02f8-4f10-9fd3-5d3b0d699698 could not be found. {{(pid=122399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:48:38.911934 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-ca049024-3588-4152-bfaf-63b64404c631 tempest-VolumesNegativeTest-1933557549 tempest-VolumesNegativeTest-1933557549-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/e170fc65-02f8-4f10-9fd3-5d3b0d699698" status: 404 len: 109 microversion: 2.1 time: 0.114059 Dec 16 15:48:38.930879 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 4/8] 10.222.0.31 () {58 vars in 1244 bytes} [Thu Dec 16 15:48:38 2021] GET /compute/v2.1/os-volumes/e170fc65-02f8-4f10-9fd3-5d3b0d699698 => generated 109 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:48:39.016374 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-f768d5f0-c559-44b9-a117-7955becef5d9 tempest-VolumesTestJSON-1632861882 tempest-VolumesTestJSON-1632861882-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/6a0a3d17-e135-462c-82ec-30e18d4e2d72" status: 200 len: 351 microversion: 2.1 time: 0.150100 Dec 16 15:48:39.017357 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 5/9] 10.222.0.31 () {58 vars in 1244 bytes} [Thu Dec 16 15:48:38 2021] GET /compute/v2.1/os-volumes/6a0a3d17-e135-462c-82ec-30e18d4e2d72 => generated 351 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:48:39.991418 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-9a51f5d1-f13a-4706-a25c-0d718f93eb2d tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-579337332", "imageRef": "2a1434ad-0c2c-4725-baad-a605624baf01", "flavorRef": "452", "networks": [{"uuid": "8f180a66-3dac-433f-ad86-2980dd11d2cf"}]}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:48:40.138309 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.network.neutron [None req-9a51f5d1-f13a-4706-a25c-0d718f93eb2d tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] validate_networks() for [('8f180a66-3dac-433f-ad86-2980dd11d2cf', None, None, None, None, None)] {{(pid=122399) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 15:48:40.486513 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-46ea1b42-e758-4ab2-a1e0-c35c60c1a376 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1714173013", "imageRef": "2a1434ad-0c2c-4725-baad-a605624baf01", "flavorRef": "452", "networks": [{"uuid": "4e96172c-0b71-4de2-95ab-4226e7a02984"}]}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:48:40.742199 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.network.neutron [None req-46ea1b42-e758-4ab2-a1e0-c35c60c1a376 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] validate_networks() for [('4e96172c-0b71-4de2-95ab-4226e7a02984', None, None, None, None, None)] {{(pid=122398) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 15:48:41.522543 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-9a51f5d1-f13a-4706-a25c-0d718f93eb2d tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Flavor limits 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 15:48:41.523487 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-9a51f5d1-f13a-4706-a25c-0d718f93eb2d tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Image limits 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 15:48:41.524823 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-9a51f5d1-f13a-4706-a25c-0d718f93eb2d tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Flavor pref 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 15:48:41.528161 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-9a51f5d1-f13a-4706-a25c-0d718f93eb2d tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Image pref 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 15:48:41.529912 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-9a51f5d1-f13a-4706-a25c-0d718f93eb2d tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 15:48:41.554492 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9a51f5d1-f13a-4706-a25c-0d718f93eb2d tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:41.555274 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9a51f5d1-f13a-4706-a25c-0d718f93eb2d tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:41.557382 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9a51f5d1-f13a-4706-a25c-0d718f93eb2d tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:41.558041 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9a51f5d1-f13a-4706-a25c-0d718f93eb2d tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:41.597087 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-9a51f5d1-f13a-4706-a25c-0d718f93eb2d tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Getting quotas for project e5edb8b1d36e4f01bc38f277910faf05. Resources: {'instances', 'ram', 'cores'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:48:41.613819 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-9a51f5d1-f13a-4706-a25c-0d718f93eb2d tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Getting quotas for user 13254b92b9e94bda88f0881524ae26bd and project e5edb8b1d36e4f01bc38f277910faf05. Resources: {'instances', 'ram', 'cores'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:48:41.636618 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-9a51f5d1-f13a-4706-a25c-0d718f93eb2d tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Going to run 1 instances... {{(pid=122399) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 15:48:41.644034 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-9a51f5d1-f13a-4706-a25c-0d718f93eb2d tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a1434ad-0c2c-4725-baad-a605624baf01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 15:48:41.853285 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-9a51f5d1-f13a-4706-a25c-0d718f93eb2d tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.007046 Dec 16 15:48:41.862772 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 5/10] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Dec 16 15:48:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 2022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 15:48:41.873887 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-c2f7e1ce-5be9-4812-96dd-e8b156d9ef0c tempest-VolumesTestJSON-1632861882 tempest-VolumesTestJSON-1632861882-project] Calling method '.version_select at 0x7fed5fc551f0>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:41.992234 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-46ea1b42-e758-4ab2-a1e0-c35c60c1a376 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Flavor limits 0:0:0 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 15:48:41.992911 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-46ea1b42-e758-4ab2-a1e0-c35c60c1a376 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Image limits 0:0:0 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 15:48:41.993922 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-46ea1b42-e758-4ab2-a1e0-c35c60c1a376 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Flavor pref 0:0:0 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 15:48:41.994423 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-46ea1b42-e758-4ab2-a1e0-c35c60c1a376 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Image pref 0:0:0 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 15:48:41.994962 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-46ea1b42-e758-4ab2-a1e0-c35c60c1a376 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 15:48:42.019888 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-46ea1b42-e758-4ab2-a1e0-c35c60c1a376 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:42.020606 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-46ea1b42-e758-4ab2-a1e0-c35c60c1a376 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:42.021840 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-46ea1b42-e758-4ab2-a1e0-c35c60c1a376 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:42.022480 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-46ea1b42-e758-4ab2-a1e0-c35c60c1a376 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:42.023067 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-c2f7e1ce-5be9-4812-96dd-e8b156d9ef0c tempest-VolumesTestJSON-1632861882 tempest-VolumesTestJSON-1632861882-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/bc76bced-6937-411f-825d-388446717789" status: 200 len: 350 microversion: 2.1 time: 0.157038 Dec 16 15:48:42.023659 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 6/11] 10.222.0.31 () {58 vars in 1244 bytes} [Thu Dec 16 15:48:41 2021] GET /compute/v2.1/os-volumes/bc76bced-6937-411f-825d-388446717789 => generated 350 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:48:42.055262 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-7f101524-327a-4747-912a-607581fe7817 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:42.056214 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-7f101524-327a-4747-912a-607581fe7817 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:48:42.085318 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.quota [None req-46ea1b42-e758-4ab2-a1e0-c35c60c1a376 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Getting quotas for project 44bf2643f52c4cc5aa01ae68ef13e12f. Resources: {'instances', 'ram', 'cores'} {{(pid=122398) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:48:42.093636 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.quota [None req-46ea1b42-e758-4ab2-a1e0-c35c60c1a376 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Getting quotas for user 9b1c255006524ad9b700c0711ecbd569 and project 44bf2643f52c4cc5aa01ae68ef13e12f. Resources: {'instances', 'ram', 'cores'} {{(pid=122398) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:48:42.113826 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-46ea1b42-e758-4ab2-a1e0-c35c60c1a376 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Going to run 1 instances... {{(pid=122398) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 15:48:42.116903 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-46ea1b42-e758-4ab2-a1e0-c35c60c1a376 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a1434ad-0c2c-4725-baad-a605624baf01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122398) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 15:48:42.345608 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-46ea1b42-e758-4ab2-a1e0-c35c60c1a376 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.316230 Dec 16 15:48:42.347593 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 6/12] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Dec 16 15:48:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 2321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 15:48:42.375980 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-eac74a64-6be6-4c71-8e3f-b9a01ee16eee tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:42.376998 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-eac74a64-6be6-4c71-8e3f-b9a01ee16eee tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:48:42.464769 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-7f101524-327a-4747-912a-607581fe7817 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13254b92b9e94bda88f0881524ae26bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5edb8b1d36e4f01bc38f277910faf05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:48:42.498686 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-7f101524-327a-4747-912a-607581fe7817 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 200 len: 1214 microversion: 2.1 time: 0.453833 Dec 16 15:48:42.511819 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 7/13] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:48:42 2021] GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 1214 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:48:42.580652 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-eac74a64-6be6-4c71-8e3f-b9a01ee16eee tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:48:42.613608 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-eac74a64-6be6-4c71-8e3f-b9a01ee16eee tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc" status: 200 len: 1218 microversion: 2.1 time: 0.256759 Dec 16 15:48:42.620077 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 7/14] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:48:42 2021] GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc => generated 1218 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:48:43.522934 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-5e62a082-64d4-40bb-8055-16008064e8bc tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:43.524500 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-5e62a082-64d4-40bb-8055-16008064e8bc tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:48:43.628034 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-5e62a082-64d4-40bb-8055-16008064e8bc tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13254b92b9e94bda88f0881524ae26bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5edb8b1d36e4f01bc38f277910faf05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:48:43.636355 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-8c15315d-74af-4e3c-9350-fb483fdc3b9f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:43.637552 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-8c15315d-74af-4e3c-9350-fb483fdc3b9f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:48:43.646915 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-5e62a082-64d4-40bb-8055-16008064e8bc tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 200 len: 1214 microversion: 2.1 time: 0.131016 Dec 16 15:48:43.647497 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 8/15] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:48:43 2021] GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:48:43.740819 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-8c15315d-74af-4e3c-9350-fb483fdc3b9f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:48:43.775625 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-8c15315d-74af-4e3c-9350-fb483fdc3b9f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc" status: 200 len: 1218 microversion: 2.1 time: 0.142874 Dec 16 15:48:43.779630 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 8/16] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:48:43 2021] GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc => generated 1218 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:48:43.800016 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-0f30f1d3-7963-4ea1-bb45-3eeae7661e96 tempest-VolumesTestJSON-1632861882 tempest-VolumesTestJSON-1632861882-project] Calling method '.version_select at 0x7fed5f414280>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:43.937764 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-0f30f1d3-7963-4ea1-bb45-3eeae7661e96 tempest-VolumesTestJSON-1632861882 tempest-VolumesTestJSON-1632861882-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/b4cd3a47-1de7-44ab-b556-713cb340c46f" status: 200 len: 350 microversion: 2.1 time: 0.141421 Dec 16 15:48:43.939369 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 9/17] 10.222.0.31 () {58 vars in 1244 bytes} [Thu Dec 16 15:48:43 2021] GET /compute/v2.1/os-volumes/b4cd3a47-1de7-44ab-b556-713cb340c46f => generated 350 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:48:43.956000 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-9bcaadc6-a924-4dad-a5dc-d7d99b62c0d5 tempest-VolumesTestJSON-1632861882 tempest-VolumesTestJSON-1632861882-project] Calling method '.version_select at 0x7fed5eb98430>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:44.174594 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-9bcaadc6-a924-4dad-a5dc-d7d99b62c0d5 tempest-VolumesTestJSON-1632861882 tempest-VolumesTestJSON-1632861882-project] 10.222.0.31 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.223701 Dec 16 15:48:44.181971 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 9/18] 10.222.0.31 () {58 vars in 1133 bytes} [Thu Dec 16 15:48:43 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:48:44.194749 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-7376a5b5-7857-4b65-88e4-25bd5426f80e tempest-VolumesTestJSON-1632861882 tempest-VolumesTestJSON-1632861882-project] Calling method '.version_select at 0x7fed5f414ca0>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:44.435632 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-7376a5b5-7857-4b65-88e4-25bd5426f80e tempest-VolumesTestJSON-1632861882 tempest-VolumesTestJSON-1632861882-project] 10.222.0.31 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.244468 Dec 16 15:48:44.436198 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 10/19] 10.222.0.31 () {58 vars in 1148 bytes} [Thu Dec 16 15:48:44 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:48:44.448159 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-086030f5-06af-477f-8935-f9b111ac9f90 tempest-VolumesTestJSON-1632861882 tempest-VolumesTestJSON-1632861882-project] Calling method '.version_select at 0x7fed5eb98ee0>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:44.568570 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-086030f5-06af-477f-8935-f9b111ac9f90 tempest-VolumesTestJSON-1632861882 tempest-VolumesTestJSON-1632861882-project] 10.222.0.31 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.124380 Dec 16 15:48:44.569444 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 10/20] 10.222.0.31 () {58 vars in 1133 bytes} [Thu Dec 16 15:48:44 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:48:44.580271 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-92edea3f-77e3-4894-9391-1560576a89fa tempest-VolumesTestJSON-1632861882 tempest-VolumesTestJSON-1632861882-project] Calling method '.version_select at 0x7fed5f4149d0>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:44.665062 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-6f1e4c92-068e-417a-be94-23f4299d7855 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:44.676323 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-6f1e4c92-068e-417a-be94-23f4299d7855 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:48:44.699616 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6f1e4c92-068e-417a-be94-23f4299d7855 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:44.700476 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6f1e4c92-068e-417a-be94-23f4299d7855 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:44.704252 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6f1e4c92-068e-417a-be94-23f4299d7855 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:44.704987 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6f1e4c92-068e-417a-be94-23f4299d7855 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:44.719652 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-92edea3f-77e3-4894-9391-1560576a89fa tempest-VolumesTestJSON-1632861882 tempest-VolumesTestJSON-1632861882-project] 10.222.0.31 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.141129 Dec 16 15:48:44.729592 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 11/21] 10.222.0.31 () {58 vars in 1166 bytes} [Thu Dec 16 15:48:44 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:48:44.734812 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-f8265eae-fdc1-47f1-84ca-1d4952524855 tempest-VolumesTestJSON-1632861882 tempest-VolumesTestJSON-1632861882-project] Calling method '.version_select at 0x7fed5fe17280>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:44.939345 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-f8265eae-fdc1-47f1-84ca-1d4952524855 tempest-VolumesTestJSON-1632861882 tempest-VolumesTestJSON-1632861882-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.208153 Dec 16 15:48:44.940514 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 12/22] 10.222.0.31 () {58 vars in 1169 bytes} [Thu Dec 16 15:48:44 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:48:44.947812 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-b785371e-6774-4d71-9df8-dc8dd49b7840 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:44.948751 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-b785371e-6774-4d71-9df8-dc8dd49b7840 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:48:44.967521 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b785371e-6774-4d71-9df8-dc8dd49b7840 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:44.968542 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b785371e-6774-4d71-9df8-dc8dd49b7840 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:44.970058 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b785371e-6774-4d71-9df8-dc8dd49b7840 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:44.974106 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b785371e-6774-4d71-9df8-dc8dd49b7840 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:45.077175 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-6f1e4c92-068e-417a-be94-23f4299d7855 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13254b92b9e94bda88f0881524ae26bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5edb8b1d36e4f01bc38f277910faf05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:48:45.108825 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-6f1e4c92-068e-417a-be94-23f4299d7855 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 200 len: 1218 microversion: 2.1 time: 0.448765 Dec 16 15:48:45.118668 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 11/23] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:48:44 2021] GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 1218 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:48:45.123960 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-35ca5cba-ad32-4442-9fa4-e55dce8414d7 tempest-VolumesTestJSON-1632861882 tempest-VolumesTestJSON-1632861882-project] Calling method '.version_select at 0x7fed5eb1f940>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:45.241857 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-35ca5cba-ad32-4442-9fa4-e55dce8414d7 tempest-VolumesTestJSON-1632861882 tempest-VolumesTestJSON-1632861882-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.121598 Dec 16 15:48:45.243295 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 12/24] 10.222.0.31 () {58 vars in 1154 bytes} [Thu Dec 16 15:48:45 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:48:45.252927 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-b785371e-6774-4d71-9df8-dc8dd49b7840 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:48:45.254355 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-0a256282-8f7a-4c79-8463-a1bdd526d92f tempest-VolumesTestJSON-1632861882 tempest-VolumesTestJSON-1632861882-project] Calling method '.version_select at 0x7fed5eb4c280>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:45.279497 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-b785371e-6774-4d71-9df8-dc8dd49b7840 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc" status: 200 len: 1222 microversion: 2.1 time: 0.337643 Dec 16 15:48:45.285714 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 13/25] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:48:44 2021] GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc => generated 1222 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:48:45.357007 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-0a256282-8f7a-4c79-8463-a1bdd526d92f tempest-VolumesTestJSON-1632861882 tempest-VolumesTestJSON-1632861882-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.106199 Dec 16 15:48:45.357948 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 13/26] 10.222.0.31 () {58 vars in 1187 bytes} [Thu Dec 16 15:48:45 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:48:45.370423 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-c7ce6a41-f89e-4e40-bca4-bbf0ade16587 tempest-VolumesTestJSON-1632861882 tempest-VolumesTestJSON-1632861882-project] Calling method '.version_select at 0x7fed5eb16820>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:45.465388 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-c7ce6a41-f89e-4e40-bca4-bbf0ade16587 tempest-VolumesTestJSON-1632861882 tempest-VolumesTestJSON-1632861882-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.098756 Dec 16 15:48:45.466276 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 14/27] 10.222.0.31 () {58 vars in 1154 bytes} [Thu Dec 16 15:48:45 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:48:46.134165 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-6826aa5e-e8eb-44ea-881e-49538299e1e9 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:46.134778 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-6826aa5e-e8eb-44ea-881e-49538299e1e9 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:48:46.141587 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6826aa5e-e8eb-44ea-881e-49538299e1e9 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:46.149242 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6826aa5e-e8eb-44ea-881e-49538299e1e9 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:46.150125 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6826aa5e-e8eb-44ea-881e-49538299e1e9 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:46.150740 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6826aa5e-e8eb-44ea-881e-49538299e1e9 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:46.265285 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-6826aa5e-e8eb-44ea-881e-49538299e1e9 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13254b92b9e94bda88f0881524ae26bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5edb8b1d36e4f01bc38f277910faf05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:48:46.290630 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-6826aa5e-e8eb-44ea-881e-49538299e1e9 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 200 len: 1218 microversion: 2.1 time: 0.157999 Dec 16 15:48:46.291267 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 14/28] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:48:46 2021] GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 1218 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:48:46.300116 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-9122d0d6-622f-482e-b025-d369c9f3dc33 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:46.301561 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-9122d0d6-622f-482e-b025-d369c9f3dc33 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:48:46.315521 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9122d0d6-622f-482e-b025-d369c9f3dc33 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:46.316189 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9122d0d6-622f-482e-b025-d369c9f3dc33 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:46.320605 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9122d0d6-622f-482e-b025-d369c9f3dc33 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:46.322180 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9122d0d6-622f-482e-b025-d369c9f3dc33 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:46.502839 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-9122d0d6-622f-482e-b025-d369c9f3dc33 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:48:46.522950 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-9122d0d6-622f-482e-b025-d369c9f3dc33 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc" status: 200 len: 1222 microversion: 2.1 time: 0.224734 Dec 16 15:48:46.523228 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 15/29] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:48:46 2021] GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc => generated 1222 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:48:47.307105 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-e2cd9450-5868-4c77-842f-628c5fdab5b6 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:47.307720 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-e2cd9450-5868-4c77-842f-628c5fdab5b6 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:48:47.340984 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e2cd9450-5868-4c77-842f-628c5fdab5b6 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:47.341761 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e2cd9450-5868-4c77-842f-628c5fdab5b6 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:47.343692 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e2cd9450-5868-4c77-842f-628c5fdab5b6 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:47.343692 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e2cd9450-5868-4c77-842f-628c5fdab5b6 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:47.539656 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-eab9d3a9-f354-46eb-886b-f2c579c917d4 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:47.541103 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-eab9d3a9-f354-46eb-886b-f2c579c917d4 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:48:47.549257 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-eab9d3a9-f354-46eb-886b-f2c579c917d4 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:47.555094 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-e2cd9450-5868-4c77-842f-628c5fdab5b6 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13254b92b9e94bda88f0881524ae26bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5edb8b1d36e4f01bc38f277910faf05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:48:47.564165 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-e2cd9450-5868-4c77-842f-628c5fdab5b6 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 200 len: 1210 microversion: 2.1 time: 0.260835 Dec 16 15:48:47.566376 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-eab9d3a9-f354-46eb-886b-f2c579c917d4 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:47.570735 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-eab9d3a9-f354-46eb-886b-f2c579c917d4 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:47.574192 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-eab9d3a9-f354-46eb-886b-f2c579c917d4 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:47.574712 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 15/30] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:48:47 2021] GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 1210 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:48:47.778804 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-eab9d3a9-f354-46eb-886b-f2c579c917d4 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:48:47.788485 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-eab9d3a9-f354-46eb-886b-f2c579c917d4 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc" status: 200 len: 1278 microversion: 2.1 time: 0.253162 Dec 16 15:48:47.803852 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 16/31] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:48:47 2021] GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc => generated 1278 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:48:48.588052 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-58dc6462-c475-486a-a9e3-f600623c24f7 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:48.589304 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-58dc6462-c475-486a-a9e3-f600623c24f7 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:48:48.604406 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-58dc6462-c475-486a-a9e3-f600623c24f7 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:48.605349 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-58dc6462-c475-486a-a9e3-f600623c24f7 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:48.606396 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-58dc6462-c475-486a-a9e3-f600623c24f7 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:48.607033 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-58dc6462-c475-486a-a9e3-f600623c24f7 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:48.807550 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-88393b79-e47a-4e5b-b7a9-44a2bedd8527 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:48.808152 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-88393b79-e47a-4e5b-b7a9-44a2bedd8527 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:48:48.818906 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-88393b79-e47a-4e5b-b7a9-44a2bedd8527 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:48.825661 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-88393b79-e47a-4e5b-b7a9-44a2bedd8527 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:48.832292 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-88393b79-e47a-4e5b-b7a9-44a2bedd8527 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:48.832961 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-88393b79-e47a-4e5b-b7a9-44a2bedd8527 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:48.913611 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-58dc6462-c475-486a-a9e3-f600623c24f7 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13254b92b9e94bda88f0881524ae26bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5edb8b1d36e4f01bc38f277910faf05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:48:48.954849 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-58dc6462-c475-486a-a9e3-f600623c24f7 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 200 len: 1272 microversion: 2.1 time: 0.370397 Dec 16 15:48:48.979503 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 16/32] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:48:48 2021] GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 1272 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:48:49.148469 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-88393b79-e47a-4e5b-b7a9-44a2bedd8527 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:48:49.173536 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-88393b79-e47a-4e5b-b7a9-44a2bedd8527 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc" status: 200 len: 1276 microversion: 2.1 time: 0.362128 Dec 16 15:48:49.186809 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 17/33] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:48:48 2021] GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc => generated 1276 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:48:49.990461 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-e74c877b-bd76-408b-9711-5eab7fc5c757 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:49.991174 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-e74c877b-bd76-408b-9711-5eab7fc5c757 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:48:50.009997 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e74c877b-bd76-408b-9711-5eab7fc5c757 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:50.010447 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e74c877b-bd76-408b-9711-5eab7fc5c757 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:50.011248 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e74c877b-bd76-408b-9711-5eab7fc5c757 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:50.011776 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e74c877b-bd76-408b-9711-5eab7fc5c757 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:50.192460 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-07106c95-2d68-4f93-8ae3-bfc28c956963 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:50.201802 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-07106c95-2d68-4f93-8ae3-bfc28c956963 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:48:50.201802 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-07106c95-2d68-4f93-8ae3-bfc28c956963 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:50.201802 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-07106c95-2d68-4f93-8ae3-bfc28c956963 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:50.216798 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-e74c877b-bd76-408b-9711-5eab7fc5c757 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13254b92b9e94bda88f0881524ae26bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5edb8b1d36e4f01bc38f277910faf05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:48:50.227099 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-e74c877b-bd76-408b-9711-5eab7fc5c757 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 200 len: 1272 microversion: 2.1 time: 0.241383 Dec 16 15:48:50.235093 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 17/34] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:48:49 2021] GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 1272 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:48:50.236171 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-07106c95-2d68-4f93-8ae3-bfc28c956963 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:50.242226 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-07106c95-2d68-4f93-8ae3-bfc28c956963 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:50.536273 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-07106c95-2d68-4f93-8ae3-bfc28c956963 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:48:50.568630 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-07106c95-2d68-4f93-8ae3-bfc28c956963 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc" status: 200 len: 1276 microversion: 2.1 time: 0.379258 Dec 16 15:48:50.570403 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 18/35] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:48:50 2021] GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc => generated 1276 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:48:51.110811 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-45dd7682-feb2-4164-8b71-e232ef5e0394 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'create', calling method: .version_select at 0x7fed5eb1ff70>, body: {"keypair": {"name": "tempest-keypair-93241437"}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:48:51.173064 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.quota [None req-45dd7682-feb2-4164-8b71-e232ef5e0394 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Getting quotas for project a82af4eab10342ddbdddd09e11579c36. Resources: {'key_pairs'} {{(pid=122398) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:48:51.187172 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.quota [None req-45dd7682-feb2-4164-8b71-e232ef5e0394 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Getting quotas for user 922251edc0754769985fdb8be76f5984 and project a82af4eab10342ddbdddd09e11579c36. Resources: {'key_pairs'} {{(pid=122398) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:48:51.252037 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-7d16a704-2b1d-4ce6-ae7b-30ff07a19bb4 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:51.253434 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-7d16a704-2b1d-4ce6-ae7b-30ff07a19bb4 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:48:51.274321 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7d16a704-2b1d-4ce6-ae7b-30ff07a19bb4 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:51.277542 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7d16a704-2b1d-4ce6-ae7b-30ff07a19bb4 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:51.282220 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7d16a704-2b1d-4ce6-ae7b-30ff07a19bb4 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:51.285057 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7d16a704-2b1d-4ce6-ae7b-30ff07a19bb4 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:51.771901 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-7d16a704-2b1d-4ce6-ae7b-30ff07a19bb4 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13254b92b9e94bda88f0881524ae26bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5edb8b1d36e4f01bc38f277910faf05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:48:51.794087 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-7d16a704-2b1d-4ce6-ae7b-30ff07a19bb4 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 200 len: 1314 microversion: 2.1 time: 0.545422 Dec 16 15:48:51.795596 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 19/36] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:48:51 2021] GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 1314 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:48:51.800506 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-7cfa1ddc-6931-4e6a-ad3b-60cf6fbe97b1 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:51.801551 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-7cfa1ddc-6931-4e6a-ad3b-60cf6fbe97b1 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:48:51.808808 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7cfa1ddc-6931-4e6a-ad3b-60cf6fbe97b1 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:51.809660 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7cfa1ddc-6931-4e6a-ad3b-60cf6fbe97b1 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:51.812169 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7cfa1ddc-6931-4e6a-ad3b-60cf6fbe97b1 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:51.812834 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7cfa1ddc-6931-4e6a-ad3b-60cf6fbe97b1 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:52.247555 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.quota [None req-45dd7682-feb2-4164-8b71-e232ef5e0394 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Getting quotas for project a82af4eab10342ddbdddd09e11579c36. Resources: {'key_pairs'} {{(pid=122398) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:48:52.255045 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.quota [None req-45dd7682-feb2-4164-8b71-e232ef5e0394 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Getting quotas for user 922251edc0754769985fdb8be76f5984 and project a82af4eab10342ddbdddd09e11579c36. Resources: {'key_pairs'} {{(pid=122398) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:48:52.277944 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-7cfa1ddc-6931-4e6a-ad3b-60cf6fbe97b1 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:48:52.287706 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-7cfa1ddc-6931-4e6a-ad3b-60cf6fbe97b1 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc" status: 200 len: 1318 microversion: 2.1 time: 0.490644 Dec 16 15:48:52.292444 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 20/37] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:48:51 2021] GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc => generated 1318 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:48:52.321817 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-45dd7682-feb2-4164-8b71-e232ef5e0394 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2303 microversion: 2.1 time: 1.925525 Dec 16 15:48:52.328400 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 18/38] 10.222.0.31 () {60 vars in 1157 bytes} [Thu Dec 16 15:48:50 2021] POST /compute/v2.1/os-keypairs => generated 2303 bytes in 1929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:48:52.764418 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-07e884f8-de23-44dc-b01a-253168e0bb0e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1518346349", "imageRef": "2a1434ad-0c2c-4725-baad-a605624baf01", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f48475bf-944a-4c2f-81b1-c044356a1dbb"}]}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:48:52.835162 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-87ca42ce-c35b-43f1-88bf-f0ebf1b44808 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:52.835790 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-87ca42ce-c35b-43f1-88bf-f0ebf1b44808 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:48:52.846408 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-87ca42ce-c35b-43f1-88bf-f0ebf1b44808 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:52.846947 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-87ca42ce-c35b-43f1-88bf-f0ebf1b44808 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:52.847834 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-87ca42ce-c35b-43f1-88bf-f0ebf1b44808 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:52.848276 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-87ca42ce-c35b-43f1-88bf-f0ebf1b44808 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:52.939498 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.network.neutron [None req-07e884f8-de23-44dc-b01a-253168e0bb0e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] validate_networks() for [('f48475bf-944a-4c2f-81b1-c044356a1dbb', None, None, None, None, None)] {{(pid=122399) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 15:48:53.443597 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-87ca42ce-c35b-43f1-88bf-f0ebf1b44808 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13254b92b9e94bda88f0881524ae26bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5edb8b1d36e4f01bc38f277910faf05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:48:53.459347 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-87ca42ce-c35b-43f1-88bf-f0ebf1b44808 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 200 len: 1314 microversion: 2.1 time: 0.639939 Dec 16 15:48:53.464242 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 19/39] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:48:52 2021] GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 1314 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:48:53.488636 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-98b4c8ab-fa15-4ee8-a134-ea95fc3fa92c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:53.490095 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-98b4c8ab-fa15-4ee8-a134-ea95fc3fa92c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:48:53.517073 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-98b4c8ab-fa15-4ee8-a134-ea95fc3fa92c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:53.518643 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-98b4c8ab-fa15-4ee8-a134-ea95fc3fa92c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:53.524792 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-98b4c8ab-fa15-4ee8-a134-ea95fc3fa92c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:53.531118 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-98b4c8ab-fa15-4ee8-a134-ea95fc3fa92c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:55.315962 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-98b4c8ab-fa15-4ee8-a134-ea95fc3fa92c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:48:55.344237 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-98b4c8ab-fa15-4ee8-a134-ea95fc3fa92c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc" status: 200 len: 1318 microversion: 2.1 time: 1.876656 Dec 16 15:48:55.346533 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 20/40] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:48:53 2021] GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc => generated 1318 bytes in 1881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:48:55.381883 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-177fd02c-5e3f-4e88-8fc4-a0dd5589bfe5 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:55.384978 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-177fd02c-5e3f-4e88-8fc4-a0dd5589bfe5 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:48:55.411161 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-177fd02c-5e3f-4e88-8fc4-a0dd5589bfe5 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:55.411706 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-177fd02c-5e3f-4e88-8fc4-a0dd5589bfe5 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:55.417838 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-177fd02c-5e3f-4e88-8fc4-a0dd5589bfe5 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:55.418517 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-177fd02c-5e3f-4e88-8fc4-a0dd5589bfe5 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:56.267108 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-177fd02c-5e3f-4e88-8fc4-a0dd5589bfe5 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13254b92b9e94bda88f0881524ae26bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5edb8b1d36e4f01bc38f277910faf05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:48:56.280495 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-177fd02c-5e3f-4e88-8fc4-a0dd5589bfe5 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 200 len: 1314 microversion: 2.1 time: 0.916447 Dec 16 15:48:56.281363 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 21/41] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:48:55 2021] GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 1314 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:48:56.282318 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-07e884f8-de23-44dc-b01a-253168e0bb0e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Flavor limits 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 15:48:56.282824 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-07e884f8-de23-44dc-b01a-253168e0bb0e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Image limits 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 15:48:56.283188 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-07e884f8-de23-44dc-b01a-253168e0bb0e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Flavor pref 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 15:48:56.283592 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-07e884f8-de23-44dc-b01a-253168e0bb0e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Image pref 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 15:48:56.284003 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-07e884f8-de23-44dc-b01a-253168e0bb0e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 15:48:56.294675 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-07e884f8-de23-44dc-b01a-253168e0bb0e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:56.295147 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-07e884f8-de23-44dc-b01a-253168e0bb0e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:56.306514 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-07e884f8-de23-44dc-b01a-253168e0bb0e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:56.307327 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-07e884f8-de23-44dc-b01a-253168e0bb0e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:56.365027 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-9fbf46af-b7cc-47b3-be56-e8ac787c4f3a tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:56.365611 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-9fbf46af-b7cc-47b3-be56-e8ac787c4f3a tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:48:56.372641 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-07e884f8-de23-44dc-b01a-253168e0bb0e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Getting quotas for project 290d9f6dcb5f4f878cc58690825a1e12. Resources: {'instances', 'ram', 'cores'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:48:56.374885 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9fbf46af-b7cc-47b3-be56-e8ac787c4f3a tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:56.375343 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9fbf46af-b7cc-47b3-be56-e8ac787c4f3a tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:56.376145 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9fbf46af-b7cc-47b3-be56-e8ac787c4f3a tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:56.376590 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9fbf46af-b7cc-47b3-be56-e8ac787c4f3a tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:56.386624 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-07e884f8-de23-44dc-b01a-253168e0bb0e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Getting quotas for user 00b68c71f879411a8374c609a182d704 and project 290d9f6dcb5f4f878cc58690825a1e12. Resources: {'instances', 'ram', 'cores'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:48:56.423522 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-07e884f8-de23-44dc-b01a-253168e0bb0e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Going to run 1 instances... {{(pid=122399) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 15:48:56.446151 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-07e884f8-de23-44dc-b01a-253168e0bb0e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a1434ad-0c2c-4725-baad-a605624baf01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 15:48:56.654937 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-07e884f8-de23-44dc-b01a-253168e0bb0e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.361093 Dec 16 15:48:56.655992 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 21/42] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Dec 16 15:48:52 2021] POST /compute/v2.1/servers => generated 383 bytes in 4363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 15:48:56.668825 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-c3bb598d-dbb8-4be2-8eb8-e0472993173a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:56.680610 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-c3bb598d-dbb8-4be2-8eb8-e0472993173a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:48:57.016970 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-c3bb598d-dbb8-4be2-8eb8-e0472993173a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:48:57.045481 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-c3bb598d-dbb8-4be2-8eb8-e0472993173a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1222 microversion: 2.1 time: 0.379758 Dec 16 15:48:57.048032 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 22/43] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:48:56 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1222 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:48:57.296779 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-91443af5-e179-4dbb-a505-24bf12d1b4e4 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:57.298197 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-91443af5-e179-4dbb-a505-24bf12d1b4e4 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:48:57.305331 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-91443af5-e179-4dbb-a505-24bf12d1b4e4 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:57.311269 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-91443af5-e179-4dbb-a505-24bf12d1b4e4 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:57.313468 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-91443af5-e179-4dbb-a505-24bf12d1b4e4 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:57.329751 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-91443af5-e179-4dbb-a505-24bf12d1b4e4 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:57.722768 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-9fbf46af-b7cc-47b3-be56-e8ac787c4f3a tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:48:57.738372 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-9fbf46af-b7cc-47b3-be56-e8ac787c4f3a tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc" status: 200 len: 1318 microversion: 2.1 time: 1.377154 Dec 16 15:48:57.755060 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 22/44] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:48:56 2021] GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc => generated 1318 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:48:57.755060 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-1bb2ee4f-f662-4527-b5f7-72a18821e0b7 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-532311826", "imageRef": "2a1434ad-0c2c-4725-baad-a605624baf01", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f48475bf-944a-4c2f-81b1-c044356a1dbb"}]}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:48:57.926507 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.network.neutron [None req-1bb2ee4f-f662-4527-b5f7-72a18821e0b7 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] validate_networks() for [('f48475bf-944a-4c2f-81b1-c044356a1dbb', None, None, None, None, None)] {{(pid=122398) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 15:48:57.996413 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-91443af5-e179-4dbb-a505-24bf12d1b4e4 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13254b92b9e94bda88f0881524ae26bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5edb8b1d36e4f01bc38f277910faf05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:48:58.006988 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-91443af5-e179-4dbb-a505-24bf12d1b4e4 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 200 len: 1314 microversion: 2.1 time: 0.712237 Dec 16 15:48:58.017448 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 23/45] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:48:57 2021] GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 1314 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:48:58.918069 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-183c1e4c-929c-4a4e-818b-c053356cc92e req-52a692c3-7ae7-44d4-8883-811c8d7914c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b15a27c-e6e3-4ac9-8882-9e52028c3bbd", "tag": "f5b55a14-2204-4e1f-a1f9-794314afd998"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:48:58.926941 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:48:58.926941 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:48:58.960489 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-183c1e4c-929c-4a4e-818b-c053356cc92e req-52a692c3-7ae7-44d4-8883-811c8d7914c3 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:58.965288 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-183c1e4c-929c-4a4e-818b-c053356cc92e req-52a692c3-7ae7-44d4-8883-811c8d7914c3 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:59.082049 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-183c1e4c-929c-4a4e-818b-c053356cc92e req-52a692c3-7ae7-44d4-8883-811c8d7914c3 service nova] Creating event network-changed:f5b55a14-2204-4e1f-a1f9-794314afd998 for instance 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd on hv-cinder-78447 Dec 16 15:48:59.082586 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-183c1e4c-929c-4a4e-818b-c053356cc92e req-52a692c3-7ae7-44d4-8883-811c8d7914c3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122399) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 16 15:48:59.099662 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-09a71966-b108-4311-b778-13f756dae454 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:59.100337 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-09a71966-b108-4311-b778-13f756dae454 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:59.102381 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-09a71966-b108-4311-b778-13f756dae454 None None] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:59.104644 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-09a71966-b108-4311-b778-13f756dae454 None None] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:59.154155 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.compute.rpcapi [None req-09a71966-b108-4311-b778-13f756dae454 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 16 15:48:59.163677 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-09a71966-b108-4311-b778-13f756dae454 None None] Releasing lock "compute-rpcapi-router" {{(pid=122399) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 16 15:48:59.247701 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-09a71966-b108-4311-b778-13f756dae454 None None] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.925507 Dec 16 15:48:59.248614 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 24/46] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:48:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:48:59.253932 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-0613fd96-5eec-4e8f-b0bf-9ef85579bc60 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:48:59.254866 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-0613fd96-5eec-4e8f-b0bf-9ef85579bc60 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:48:59.276274 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0613fd96-5eec-4e8f-b0bf-9ef85579bc60 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:59.277935 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0613fd96-5eec-4e8f-b0bf-9ef85579bc60 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:48:59.279056 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0613fd96-5eec-4e8f-b0bf-9ef85579bc60 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:48:59.282179 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0613fd96-5eec-4e8f-b0bf-9ef85579bc60 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:00.301584 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-0613fd96-5eec-4e8f-b0bf-9ef85579bc60 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:00.321375 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-0613fd96-5eec-4e8f-b0bf-9ef85579bc60 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc" status: 200 len: 1318 microversion: 2.1 time: 1.062780 Dec 16 15:49:00.322330 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 25/47] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:48:59 2021] GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc => generated 1318 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:00.329302 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-d3e4610a-182b-4111-a5a5-f59d23c4333e tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:00.329949 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-d3e4610a-182b-4111-a5a5-f59d23c4333e tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:00.361882 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d3e4610a-182b-4111-a5a5-f59d23c4333e tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:00.362686 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d3e4610a-182b-4111-a5a5-f59d23c4333e tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:00.363851 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d3e4610a-182b-4111-a5a5-f59d23c4333e tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:00.367187 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d3e4610a-182b-4111-a5a5-f59d23c4333e tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:00.894556 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-1bb2ee4f-f662-4527-b5f7-72a18821e0b7 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Flavor limits 0:0:0 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 15:49:00.895640 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-1bb2ee4f-f662-4527-b5f7-72a18821e0b7 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Image limits 0:0:0 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 15:49:00.895640 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-1bb2ee4f-f662-4527-b5f7-72a18821e0b7 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Flavor pref 0:0:0 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 15:49:00.895970 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-1bb2ee4f-f662-4527-b5f7-72a18821e0b7 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Image pref 0:0:0 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 15:49:00.896443 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-1bb2ee4f-f662-4527-b5f7-72a18821e0b7 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 15:49:00.908066 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1bb2ee4f-f662-4527-b5f7-72a18821e0b7 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:00.917122 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1bb2ee4f-f662-4527-b5f7-72a18821e0b7 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:00.921428 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1bb2ee4f-f662-4527-b5f7-72a18821e0b7 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:00.924019 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1bb2ee4f-f662-4527-b5f7-72a18821e0b7 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:01.001737 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.quota [None req-1bb2ee4f-f662-4527-b5f7-72a18821e0b7 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Getting quotas for project 290d9f6dcb5f4f878cc58690825a1e12. Resources: {'instances', 'ram', 'cores'} {{(pid=122398) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:49:01.015392 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.quota [None req-1bb2ee4f-f662-4527-b5f7-72a18821e0b7 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Getting quotas for user 00b68c71f879411a8374c609a182d704 and project 290d9f6dcb5f4f878cc58690825a1e12. Resources: {'instances', 'ram', 'cores'} {{(pid=122398) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:49:01.038408 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-d3e4610a-182b-4111-a5a5-f59d23c4333e tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13254b92b9e94bda88f0881524ae26bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5edb8b1d36e4f01bc38f277910faf05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:01.049204 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-d3e4610a-182b-4111-a5a5-f59d23c4333e tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 200 len: 1314 microversion: 2.1 time: 0.723451 Dec 16 15:49:01.054504 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 26/48] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:00 2021] GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 1314 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:01.064033 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-1bb2ee4f-f662-4527-b5f7-72a18821e0b7 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Going to run 1 instances... {{(pid=122398) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 15:49:01.064033 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-1bb2ee4f-f662-4527-b5f7-72a18821e0b7 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a1434ad-0c2c-4725-baad-a605624baf01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122398) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 15:49:01.095227 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-a08f05a2-61e8-475e-83a2-6a734557227c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1994616412", "imageRef": "2a1434ad-0c2c-4725-baad-a605624baf01", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "995ae86b-522a-475e-97b2-0044dee2628f"}], "security_groups": [{"name": "tempest-securitygroup--413509739"}], "key_name": "tempest-keypair-93241437", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:01.132688 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-1bb2ee4f-f662-4527-b5f7-72a18821e0b7 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.384503 Dec 16 15:49:01.133340 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 23/49] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Dec 16 15:48:57 2021] POST /compute/v2.1/servers => generated 383 bytes in 3386 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 15:49:01.444789 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.network.neutron [None req-a08f05a2-61e8-475e-83a2-6a734557227c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] validate_networks() for [('995ae86b-522a-475e-97b2-0044dee2628f', None, None, None, None, None)] {{(pid=122399) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 15:49:01.750711 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-9fdfdc1d-3384-46a7-82d3-0f755fad2156 req-dba74b0a-0dc4-4b89-a42c-9e9ee4acdf23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "833cc951-4fe1-4d89-884f-6c98308de4bc", "tag": "83410d19-2bd0-4afe-845a-c137ecec96ca"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:01.753722 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:49:01.753722 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:49:01.786281 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-9fdfdc1d-3384-46a7-82d3-0f755fad2156 req-dba74b0a-0dc4-4b89-a42c-9e9ee4acdf23 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:01.792156 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-9fdfdc1d-3384-46a7-82d3-0f755fad2156 req-dba74b0a-0dc4-4b89-a42c-9e9ee4acdf23 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:01.849595 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-9fdfdc1d-3384-46a7-82d3-0f755fad2156 req-dba74b0a-0dc4-4b89-a42c-9e9ee4acdf23 service nova] Creating event network-changed:83410d19-2bd0-4afe-845a-c137ecec96ca for instance 833cc951-4fe1-4d89-884f-6c98308de4bc on hv-cinder-78447 Dec 16 15:49:01.857572 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-9fdfdc1d-3384-46a7-82d3-0f755fad2156 req-dba74b0a-0dc4-4b89-a42c-9e9ee4acdf23 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122398) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 16 15:49:01.859018 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d7d6f3c9-e953-4bcd-9a1e-84c17354c31f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:01.859661 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d7d6f3c9-e953-4bcd-9a1e-84c17354c31f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:01.860684 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d7d6f3c9-e953-4bcd-9a1e-84c17354c31f None None] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:01.861312 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d7d6f3c9-e953-4bcd-9a1e-84c17354c31f None None] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:01.886267 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.compute.rpcapi [None req-d7d6f3c9-e953-4bcd-9a1e-84c17354c31f None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 16 15:49:01.887494 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d7d6f3c9-e953-4bcd-9a1e-84c17354c31f None None] Releasing lock "compute-rpcapi-router" {{(pid=122398) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 16 15:49:01.947237 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-d7d6f3c9-e953-4bcd-9a1e-84c17354c31f None None] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.810024 Dec 16 15:49:01.948673 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 24/50] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:49:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:49:01.961862 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-ee4eca26-ab96-449e-a073-91767ea18e02 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:01.963258 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-ee4eca26-ab96-449e-a073-91767ea18e02 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:01.971997 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ee4eca26-ab96-449e-a073-91767ea18e02 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:01.972420 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ee4eca26-ab96-449e-a073-91767ea18e02 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:01.973500 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ee4eca26-ab96-449e-a073-91767ea18e02 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:01.974264 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ee4eca26-ab96-449e-a073-91767ea18e02 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:02.134791 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-ee4eca26-ab96-449e-a073-91767ea18e02 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:02.146679 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-ee4eca26-ab96-449e-a073-91767ea18e02 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1225 microversion: 2.1 time: 0.191765 Dec 16 15:49:02.161639 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 25/51] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:01 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1225 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:02.184245 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-90164a4b-dfc9-446d-9abb-cb37585cce63 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:02.186068 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-90164a4b-dfc9-446d-9abb-cb37585cce63 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:02.215116 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-90164a4b-dfc9-446d-9abb-cb37585cce63 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:02.215588 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-90164a4b-dfc9-446d-9abb-cb37585cce63 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:02.216396 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-90164a4b-dfc9-446d-9abb-cb37585cce63 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:02.216836 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-90164a4b-dfc9-446d-9abb-cb37585cce63 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:02.581177 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-a08f05a2-61e8-475e-83a2-6a734557227c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Flavor limits 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 15:49:02.581734 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-a08f05a2-61e8-475e-83a2-6a734557227c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Image limits 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 15:49:02.582392 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-a08f05a2-61e8-475e-83a2-6a734557227c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Flavor pref 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 15:49:02.582820 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-a08f05a2-61e8-475e-83a2-6a734557227c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Image pref 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 15:49:02.583240 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-a08f05a2-61e8-475e-83a2-6a734557227c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 15:49:02.604933 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a08f05a2-61e8-475e-83a2-6a734557227c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:02.605391 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a08f05a2-61e8-475e-83a2-6a734557227c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:02.606231 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a08f05a2-61e8-475e-83a2-6a734557227c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:02.611447 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a08f05a2-61e8-475e-83a2-6a734557227c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:02.626441 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-90164a4b-dfc9-446d-9abb-cb37585cce63 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:02.633823 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-90164a4b-dfc9-446d-9abb-cb37585cce63 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc" status: 200 len: 1318 microversion: 2.1 time: 0.460688 Dec 16 15:49:02.634411 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 26/52] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:02 2021] GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc => generated 1318 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:02.654213 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-459193e7-3359-446c-9aff-ebed02ae4e2b tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:02.656052 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-459193e7-3359-446c-9aff-ebed02ae4e2b tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:02.666683 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-459193e7-3359-446c-9aff-ebed02ae4e2b tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:02.668027 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-459193e7-3359-446c-9aff-ebed02ae4e2b tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:02.670560 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-459193e7-3359-446c-9aff-ebed02ae4e2b tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:02.672130 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-a08f05a2-61e8-475e-83a2-6a734557227c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Getting quotas for project a82af4eab10342ddbdddd09e11579c36. Resources: {'instances', 'ram', 'cores'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:49:02.672956 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-459193e7-3359-446c-9aff-ebed02ae4e2b tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:02.682762 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-a08f05a2-61e8-475e-83a2-6a734557227c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Getting quotas for user 922251edc0754769985fdb8be76f5984 and project a82af4eab10342ddbdddd09e11579c36. Resources: {'instances', 'ram', 'cores'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:49:02.759576 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-a08f05a2-61e8-475e-83a2-6a734557227c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Going to run 1 instances... {{(pid=122399) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 15:49:02.772853 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-a08f05a2-61e8-475e-83a2-6a734557227c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a1434ad-0c2c-4725-baad-a605624baf01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 15:49:02.946554 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-a08f05a2-61e8-475e-83a2-6a734557227c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.878047 Dec 16 15:49:02.952037 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 27/53] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Dec 16 15:49:01 2021] POST /compute/v2.1/servers => generated 401 bytes in 1881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 15:49:02.959500 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-4f72eedf-b982-45a2-aa54-30dc1751b8b1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:02.961731 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-4f72eedf-b982-45a2-aa54-30dc1751b8b1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:03.157800 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-4f72eedf-b982-45a2-aa54-30dc1751b8b1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:03.168657 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-4f72eedf-b982-45a2-aa54-30dc1751b8b1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1236 microversion: 2.1 time: 0.214968 Dec 16 15:49:03.171841 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 28/54] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:02 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1236 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:03.181469 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-6780a1a1-811c-4143-9830-8ac94af32c75 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:03.182239 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-6780a1a1-811c-4143-9830-8ac94af32c75 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:03.189925 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6780a1a1-811c-4143-9830-8ac94af32c75 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:03.190547 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6780a1a1-811c-4143-9830-8ac94af32c75 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:03.191970 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6780a1a1-811c-4143-9830-8ac94af32c75 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:03.192609 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6780a1a1-811c-4143-9830-8ac94af32c75 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:03.265440 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-459193e7-3359-446c-9aff-ebed02ae4e2b tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13254b92b9e94bda88f0881524ae26bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5edb8b1d36e4f01bc38f277910faf05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:03.284955 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-459193e7-3359-446c-9aff-ebed02ae4e2b tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 200 len: 1314 microversion: 2.1 time: 0.634976 Dec 16 15:49:03.287744 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 27/55] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:02 2021] GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 1314 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:03.321989 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-6780a1a1-811c-4143-9830-8ac94af32c75 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:03.331869 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-6780a1a1-811c-4143-9830-8ac94af32c75 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1225 microversion: 2.1 time: 0.157060 Dec 16 15:49:03.332943 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 29/56] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:03 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1225 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:49:03.651215 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-364f0817-c308-4e51-9be3-3e2b4799f012 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:03.651908 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-364f0817-c308-4e51-9be3-3e2b4799f012 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:03.664090 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-364f0817-c308-4e51-9be3-3e2b4799f012 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:03.665009 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-364f0817-c308-4e51-9be3-3e2b4799f012 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:03.667086 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-364f0817-c308-4e51-9be3-3e2b4799f012 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:03.668211 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-364f0817-c308-4e51-9be3-3e2b4799f012 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:04.188084 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-5147c932-7e79-4919-84ff-27ea1340bf3f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:04.188686 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-5147c932-7e79-4919-84ff-27ea1340bf3f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:04.199886 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5147c932-7e79-4919-84ff-27ea1340bf3f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:04.200561 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5147c932-7e79-4919-84ff-27ea1340bf3f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:04.201719 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5147c932-7e79-4919-84ff-27ea1340bf3f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:04.206282 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5147c932-7e79-4919-84ff-27ea1340bf3f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:04.243927 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-364f0817-c308-4e51-9be3-3e2b4799f012 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:04.252884 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-364f0817-c308-4e51-9be3-3e2b4799f012 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc" status: 200 len: 1318 microversion: 2.1 time: 0.605962 Dec 16 15:49:04.256690 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 28/57] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:03 2021] GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc => generated 1318 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:04.304180 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-ed4456da-22b0-4265-9720-c05dd416d76b tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:04.305639 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-ed4456da-22b0-4265-9720-c05dd416d76b tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:04.322666 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ed4456da-22b0-4265-9720-c05dd416d76b tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:04.323380 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ed4456da-22b0-4265-9720-c05dd416d76b tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:04.324566 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ed4456da-22b0-4265-9720-c05dd416d76b tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:04.325194 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ed4456da-22b0-4265-9720-c05dd416d76b tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:04.444742 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-5147c932-7e79-4919-84ff-27ea1340bf3f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:04.460915 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-5147c932-7e79-4919-84ff-27ea1340bf3f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1232 microversion: 2.1 time: 0.276446 Dec 16 15:49:04.475390 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 30/58] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:04 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1232 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:49:04.485758 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-b3fb864a-36e4-4a33-b8f5-256466523717 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:04.487876 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-b3fb864a-36e4-4a33-b8f5-256466523717 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:04.503193 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b3fb864a-36e4-4a33-b8f5-256466523717 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:04.503799 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b3fb864a-36e4-4a33-b8f5-256466523717 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:04.505159 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b3fb864a-36e4-4a33-b8f5-256466523717 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:04.518115 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b3fb864a-36e4-4a33-b8f5-256466523717 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:04.661785 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-b3fb864a-36e4-4a33-b8f5-256466523717 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:04.673742 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-b3fb864a-36e4-4a33-b8f5-256466523717 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1281 microversion: 2.1 time: 0.188383 Dec 16 15:49:04.687130 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 31/59] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:04 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1281 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:04.835771 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-ed4456da-22b0-4265-9720-c05dd416d76b tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13254b92b9e94bda88f0881524ae26bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5edb8b1d36e4f01bc38f277910faf05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:04.846988 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-ed4456da-22b0-4265-9720-c05dd416d76b tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 200 len: 1314 microversion: 2.1 time: 0.546863 Dec 16 15:49:04.847963 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 29/60] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:04 2021] GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 1314 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:49:05.269932 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ba0cc228-c621-4d76-abfe-131ea09947e8 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:05.270561 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-ba0cc228-c621-4d76-abfe-131ea09947e8 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:05.283442 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ba0cc228-c621-4d76-abfe-131ea09947e8 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:05.283895 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ba0cc228-c621-4d76-abfe-131ea09947e8 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:05.284709 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ba0cc228-c621-4d76-abfe-131ea09947e8 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:05.285122 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ba0cc228-c621-4d76-abfe-131ea09947e8 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:05.480067 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-5bfe76cd-ab60-42a0-8fef-027588d63ced tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:05.480770 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-5bfe76cd-ab60-42a0-8fef-027588d63ced tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:05.490651 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5bfe76cd-ab60-42a0-8fef-027588d63ced tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:05.491873 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5bfe76cd-ab60-42a0-8fef-027588d63ced tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:05.495274 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5bfe76cd-ab60-42a0-8fef-027588d63ced tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:05.495728 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5bfe76cd-ab60-42a0-8fef-027588d63ced tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:05.705089 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-5bfe76cd-ab60-42a0-8fef-027588d63ced tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:05.735257 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-5bfe76cd-ab60-42a0-8fef-027588d63ced tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1294 microversion: 2.1 time: 0.261033 Dec 16 15:49:05.742596 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 30/61] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:05 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1294 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:49:05.755927 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-58e6a376-50bc-4399-9530-d91d4b575832 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:05.760557 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-58e6a376-50bc-4399-9530-d91d4b575832 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:05.775306 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-58e6a376-50bc-4399-9530-d91d4b575832 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:05.779578 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-58e6a376-50bc-4399-9530-d91d4b575832 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:05.786057 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-58e6a376-50bc-4399-9530-d91d4b575832 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:05.786777 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-58e6a376-50bc-4399-9530-d91d4b575832 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:05.909173 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-58e6a376-50bc-4399-9530-d91d4b575832 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:05.911496 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-ba0cc228-c621-4d76-abfe-131ea09947e8 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:05.921711 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-ba0cc228-c621-4d76-abfe-131ea09947e8 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc" status: 200 len: 1318 microversion: 2.1 time: 0.655621 Dec 16 15:49:05.924970 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 32/62] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:05 2021] GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc => generated 1318 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:05.929719 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-e9e731a6-1696-4d0c-a444-3f2bd0fe8bc7 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:05.931477 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-e9e731a6-1696-4d0c-a444-3f2bd0fe8bc7 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:05.932321 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-58e6a376-50bc-4399-9530-d91d4b575832 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1279 microversion: 2.1 time: 0.177313 Dec 16 15:49:05.933587 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 31/63] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:05 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1279 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:05.951305 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e9e731a6-1696-4d0c-a444-3f2bd0fe8bc7 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:05.951898 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e9e731a6-1696-4d0c-a444-3f2bd0fe8bc7 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:05.953083 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e9e731a6-1696-4d0c-a444-3f2bd0fe8bc7 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:05.953665 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e9e731a6-1696-4d0c-a444-3f2bd0fe8bc7 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:06.560460 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-e9e731a6-1696-4d0c-a444-3f2bd0fe8bc7 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13254b92b9e94bda88f0881524ae26bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5edb8b1d36e4f01bc38f277910faf05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:06.579535 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-e9e731a6-1696-4d0c-a444-3f2bd0fe8bc7 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 200 len: 1314 microversion: 2.1 time: 0.652915 Dec 16 15:49:06.595221 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 33/64] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:05 2021] GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 1314 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:06.761245 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-632dc4ab-a4ce-4146-9003-3a132bf538b3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:06.761879 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-632dc4ab-a4ce-4146-9003-3a132bf538b3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:06.773767 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-632dc4ab-a4ce-4146-9003-3a132bf538b3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:06.774104 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-632dc4ab-a4ce-4146-9003-3a132bf538b3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:06.776099 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-632dc4ab-a4ce-4146-9003-3a132bf538b3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:06.776540 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-632dc4ab-a4ce-4146-9003-3a132bf538b3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:06.944593 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-0a5fdcde-9ac8-43ab-a8d8-215a44cf1d23 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:06.944985 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-0a5fdcde-9ac8-43ab-a8d8-215a44cf1d23 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:06.965951 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0a5fdcde-9ac8-43ab-a8d8-215a44cf1d23 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:06.966346 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0a5fdcde-9ac8-43ab-a8d8-215a44cf1d23 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:06.967155 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0a5fdcde-9ac8-43ab-a8d8-215a44cf1d23 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:06.967593 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0a5fdcde-9ac8-43ab-a8d8-215a44cf1d23 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:07.526154 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-632dc4ab-a4ce-4146-9003-3a132bf538b3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:07.551519 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-632dc4ab-a4ce-4146-9003-3a132bf538b3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1361 microversion: 2.1 time: 0.792475 Dec 16 15:49:07.552422 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 32/65] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:06 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1361 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:07.567157 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-d1edd6b2-95bd-4064-9b14-758ea10de2a4 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:07.568345 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-d1edd6b2-95bd-4064-9b14-758ea10de2a4 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:07.588071 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d1edd6b2-95bd-4064-9b14-758ea10de2a4 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:07.591494 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d1edd6b2-95bd-4064-9b14-758ea10de2a4 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:07.592805 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d1edd6b2-95bd-4064-9b14-758ea10de2a4 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:07.595527 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d1edd6b2-95bd-4064-9b14-758ea10de2a4 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:07.681801 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-0a5fdcde-9ac8-43ab-a8d8-215a44cf1d23 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:07.694213 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-0a5fdcde-9ac8-43ab-a8d8-215a44cf1d23 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc" status: 200 len: 1318 microversion: 2.1 time: 0.758307 Dec 16 15:49:07.700860 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 34/66] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:06 2021] GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc => generated 1318 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:07.705643 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-9d7d52fa-a353-47ab-8dc4-739242fb0217 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:07.706418 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-9d7d52fa-a353-47ab-8dc4-739242fb0217 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:07.727643 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9d7d52fa-a353-47ab-8dc4-739242fb0217 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:07.729811 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9d7d52fa-a353-47ab-8dc4-739242fb0217 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:07.734873 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9d7d52fa-a353-47ab-8dc4-739242fb0217 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:07.735564 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9d7d52fa-a353-47ab-8dc4-739242fb0217 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:07.862536 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-d1edd6b2-95bd-4064-9b14-758ea10de2a4 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:07.871318 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-d1edd6b2-95bd-4064-9b14-758ea10de2a4 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1321 microversion: 2.1 time: 0.317320 Dec 16 15:49:07.878601 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 33/67] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:07 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1321 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:08.019856 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-7e0dc239-9389-41bb-b03f-e3d9d1da250e req-bc3020dc-9505-4b53-ae6c-edd867e89d1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05750574-60a7-44f6-8fd6-d2fd52b57e91", "tag": "a162fcff-3fe8-4fc6-a489-b53c84cb0c45"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:08.021685 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:49:08.021685 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:49:08.040904 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-7e0dc239-9389-41bb-b03f-e3d9d1da250e req-bc3020dc-9505-4b53-ae6c-edd867e89d1b service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:08.041479 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-7e0dc239-9389-41bb-b03f-e3d9d1da250e req-bc3020dc-9505-4b53-ae6c-edd867e89d1b service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:08.058790 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-7e0dc239-9389-41bb-b03f-e3d9d1da250e req-bc3020dc-9505-4b53-ae6c-edd867e89d1b service nova] Creating event network-changed:a162fcff-3fe8-4fc6-a489-b53c84cb0c45 for instance 05750574-60a7-44f6-8fd6-d2fd52b57e91 on hv-cinder-78447 Dec 16 15:49:08.065925 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-7e0dc239-9389-41bb-b03f-e3d9d1da250e req-bc3020dc-9505-4b53-ae6c-edd867e89d1b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052147 Dec 16 15:49:08.066995 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 34/68] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:49:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:49:08.068490 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-9d7d52fa-a353-47ab-8dc4-739242fb0217 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13254b92b9e94bda88f0881524ae26bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5edb8b1d36e4f01bc38f277910faf05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:08.075811 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-9d7d52fa-a353-47ab-8dc4-739242fb0217 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 200 len: 1314 microversion: 2.1 time: 0.373677 Dec 16 15:49:08.076387 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 35/69] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:07 2021] GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:08.408909 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-24e97d5d-2388-473e-b847-0e9d6003d8ee req-8e62ca2f-1387-4026-93de-d0864f8eb319 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce6f3e72-0124-4937-9016-c13d65d07acd", "tag": "cc1f207a-64d8-409d-a59e-543c8d2230c6"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:08.410939 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:49:08.410939 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:49:08.431393 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-24e97d5d-2388-473e-b847-0e9d6003d8ee req-8e62ca2f-1387-4026-93de-d0864f8eb319 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:08.431738 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-24e97d5d-2388-473e-b847-0e9d6003d8ee req-8e62ca2f-1387-4026-93de-d0864f8eb319 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:08.484358 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-24e97d5d-2388-473e-b847-0e9d6003d8ee req-8e62ca2f-1387-4026-93de-d0864f8eb319 service nova] Creating event network-changed:cc1f207a-64d8-409d-a59e-543c8d2230c6 for instance ce6f3e72-0124-4937-9016-c13d65d07acd on hv-cinder-78447 Dec 16 15:49:08.498438 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-24e97d5d-2388-473e-b847-0e9d6003d8ee req-8e62ca2f-1387-4026-93de-d0864f8eb319 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090445 Dec 16 15:49:08.498438 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 35/70] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:49:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:49:08.568795 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-65f0207a-e50e-4328-b895-12a29d85d71c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:08.569669 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-65f0207a-e50e-4328-b895-12a29d85d71c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:08.577928 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-65f0207a-e50e-4328-b895-12a29d85d71c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:08.578372 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-65f0207a-e50e-4328-b895-12a29d85d71c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:08.581431 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-65f0207a-e50e-4328-b895-12a29d85d71c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:08.584623 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-65f0207a-e50e-4328-b895-12a29d85d71c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:08.719282 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-7fe37e79-c4e8-4e3b-ae0d-14cceed2b40a tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:08.720444 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-7fe37e79-c4e8-4e3b-ae0d-14cceed2b40a tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:08.731849 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7fe37e79-c4e8-4e3b-ae0d-14cceed2b40a tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:08.732754 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7fe37e79-c4e8-4e3b-ae0d-14cceed2b40a tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:08.733752 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7fe37e79-c4e8-4e3b-ae0d-14cceed2b40a tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:08.734366 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7fe37e79-c4e8-4e3b-ae0d-14cceed2b40a tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:08.825834 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-65f0207a-e50e-4328-b895-12a29d85d71c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:08.838247 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-65f0207a-e50e-4328-b895-12a29d85d71c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1361 microversion: 2.1 time: 0.273161 Dec 16 15:49:08.839057 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 36/71] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:08 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1361 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:08.896550 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-4c792ac0-c13d-4ba2-b030-5b5861146668 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:08.897390 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-4c792ac0-c13d-4ba2-b030-5b5861146668 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:08.903338 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4c792ac0-c13d-4ba2-b030-5b5861146668 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:08.904225 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4c792ac0-c13d-4ba2-b030-5b5861146668 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:08.905278 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4c792ac0-c13d-4ba2-b030-5b5861146668 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:08.905971 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4c792ac0-c13d-4ba2-b030-5b5861146668 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:08.927470 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-7fe37e79-c4e8-4e3b-ae0d-14cceed2b40a tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:08.938106 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-7fe37e79-c4e8-4e3b-ae0d-14cceed2b40a tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc" status: 200 len: 1318 microversion: 2.1 time: 0.225729 Dec 16 15:49:08.938689 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 36/72] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:08 2021] GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:09.075086 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-4c792ac0-c13d-4ba2-b030-5b5861146668 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:09.082287 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-4c792ac0-c13d-4ba2-b030-5b5861146668 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1321 microversion: 2.1 time: 0.191339 Dec 16 15:49:09.083066 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 37/73] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:08 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:09.094208 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-c9208f65-5e22-40f4-b735-f8d5571fcedf tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:09.094956 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-c9208f65-5e22-40f4-b735-f8d5571fcedf tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:09.100899 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c9208f65-5e22-40f4-b735-f8d5571fcedf tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:09.101498 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c9208f65-5e22-40f4-b735-f8d5571fcedf tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:09.102653 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c9208f65-5e22-40f4-b735-f8d5571fcedf tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:09.103144 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c9208f65-5e22-40f4-b735-f8d5571fcedf tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:09.253323 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-c9208f65-5e22-40f4-b735-f8d5571fcedf tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13254b92b9e94bda88f0881524ae26bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5edb8b1d36e4f01bc38f277910faf05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:09.262193 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-c9208f65-5e22-40f4-b735-f8d5571fcedf tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 200 len: 1314 microversion: 2.1 time: 0.173180 Dec 16 15:49:09.262944 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 37/74] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:09 2021] GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:49:09.857803 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ce21ec43-161e-4c96-acd0-41a4c21cde73 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:09.858968 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-ce21ec43-161e-4c96-acd0-41a4c21cde73 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:09.864914 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ce21ec43-161e-4c96-acd0-41a4c21cde73 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:09.865393 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ce21ec43-161e-4c96-acd0-41a4c21cde73 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:09.866182 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ce21ec43-161e-4c96-acd0-41a4c21cde73 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:09.866867 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ce21ec43-161e-4c96-acd0-41a4c21cde73 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:09.955519 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-67028af4-841c-44f7-ba12-4563a56fb7ca tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:09.956198 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-67028af4-841c-44f7-ba12-4563a56fb7ca tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:09.963479 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-67028af4-841c-44f7-ba12-4563a56fb7ca tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:09.963935 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-67028af4-841c-44f7-ba12-4563a56fb7ca tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:09.964727 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-67028af4-841c-44f7-ba12-4563a56fb7ca tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:09.965163 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-67028af4-841c-44f7-ba12-4563a56fb7ca tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:10.040092 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-ce21ec43-161e-4c96-acd0-41a4c21cde73 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:10.051112 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-ce21ec43-161e-4c96-acd0-41a4c21cde73 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1361 microversion: 2.1 time: 0.196846 Dec 16 15:49:10.051943 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 38/75] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:09 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1361 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:10.106207 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-6b54a3ec-8b38-4540-b34c-c768153219b6 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:10.107341 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-6b54a3ec-8b38-4540-b34c-c768153219b6 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:10.115056 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6b54a3ec-8b38-4540-b34c-c768153219b6 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:10.116059 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6b54a3ec-8b38-4540-b34c-c768153219b6 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:10.117060 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6b54a3ec-8b38-4540-b34c-c768153219b6 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:10.117682 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6b54a3ec-8b38-4540-b34c-c768153219b6 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:10.142462 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-67028af4-841c-44f7-ba12-4563a56fb7ca tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:10.150123 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-67028af4-841c-44f7-ba12-4563a56fb7ca tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc" status: 200 len: 1318 microversion: 2.1 time: 0.198266 Dec 16 15:49:10.159341 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 38/76] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:09 2021] GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:10.256700 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-6b54a3ec-8b38-4540-b34c-c768153219b6 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:10.264092 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-6b54a3ec-8b38-4540-b34c-c768153219b6 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1321 microversion: 2.1 time: 0.162676 Dec 16 15:49:10.264748 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 39/77] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:10 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:49:10.279547 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-c6692406-f4ff-40d4-87a3-6586c8ae2257 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:10.280166 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-c6692406-f4ff-40d4-87a3-6586c8ae2257 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:10.286207 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c6692406-f4ff-40d4-87a3-6586c8ae2257 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:10.286639 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c6692406-f4ff-40d4-87a3-6586c8ae2257 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:10.287463 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c6692406-f4ff-40d4-87a3-6586c8ae2257 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:10.287892 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c6692406-f4ff-40d4-87a3-6586c8ae2257 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:10.423108 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-c6692406-f4ff-40d4-87a3-6586c8ae2257 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13254b92b9e94bda88f0881524ae26bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5edb8b1d36e4f01bc38f277910faf05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:10.430469 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-c6692406-f4ff-40d4-87a3-6586c8ae2257 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 200 len: 1314 microversion: 2.1 time: 0.154975 Dec 16 15:49:10.431040 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 39/78] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:10 2021] GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:10.521596 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-bbaf87f6-c4e5-47f9-b363-92baecec538c req-771de237-2ece-4e76-89bf-75583f6397c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29bba044-2e01-44b1-bb03-0f367846a5f0", "tag": "1b9973de-48e3-4cb5-a15d-7bd646981f14"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:10.524257 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:49:10.524257 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:49:10.531466 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-bbaf87f6-c4e5-47f9-b363-92baecec538c req-771de237-2ece-4e76-89bf-75583f6397c9 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:10.531989 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-bbaf87f6-c4e5-47f9-b363-92baecec538c req-771de237-2ece-4e76-89bf-75583f6397c9 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:10.544241 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-bbaf87f6-c4e5-47f9-b363-92baecec538c req-771de237-2ece-4e76-89bf-75583f6397c9 service nova] Creating event network-changed:1b9973de-48e3-4cb5-a15d-7bd646981f14 for instance 29bba044-2e01-44b1-bb03-0f367846a5f0 on hv-cinder-78447 Dec 16 15:49:10.549323 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-bbaf87f6-c4e5-47f9-b363-92baecec538c req-771de237-2ece-4e76-89bf-75583f6397c9 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036560 Dec 16 15:49:10.550213 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 40/79] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:49:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:49:11.067821 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-4815b51b-74d2-4dfa-b8c1-37806856f70a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:11.068992 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-4815b51b-74d2-4dfa-b8c1-37806856f70a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:11.075071 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4815b51b-74d2-4dfa-b8c1-37806856f70a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:11.075519 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4815b51b-74d2-4dfa-b8c1-37806856f70a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:11.076372 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4815b51b-74d2-4dfa-b8c1-37806856f70a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:11.076815 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4815b51b-74d2-4dfa-b8c1-37806856f70a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:11.176658 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-b173e23b-65a8-4d50-bf2b-5e25c94ed7c8 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:11.177361 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-b173e23b-65a8-4d50-bf2b-5e25c94ed7c8 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:11.189140 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b173e23b-65a8-4d50-bf2b-5e25c94ed7c8 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:11.189618 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b173e23b-65a8-4d50-bf2b-5e25c94ed7c8 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:11.190385 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b173e23b-65a8-4d50-bf2b-5e25c94ed7c8 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:11.190808 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b173e23b-65a8-4d50-bf2b-5e25c94ed7c8 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:11.260846 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-4815b51b-74d2-4dfa-b8c1-37806856f70a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:11.268946 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-4815b51b-74d2-4dfa-b8c1-37806856f70a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1361 microversion: 2.1 time: 0.204778 Dec 16 15:49:11.269703 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 40/80] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:11 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1361 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:11.279514 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-f6c8cbec-06a1-4530-95c1-9293d5a990eb tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:11.280691 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-f6c8cbec-06a1-4530-95c1-9293d5a990eb tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:11.286769 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f6c8cbec-06a1-4530-95c1-9293d5a990eb tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:11.287209 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f6c8cbec-06a1-4530-95c1-9293d5a990eb tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:11.287975 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f6c8cbec-06a1-4530-95c1-9293d5a990eb tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:11.288482 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f6c8cbec-06a1-4530-95c1-9293d5a990eb tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:11.386377 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-b173e23b-65a8-4d50-bf2b-5e25c94ed7c8 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:11.393888 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-b173e23b-65a8-4d50-bf2b-5e25c94ed7c8 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc" status: 200 len: 1318 microversion: 2.1 time: 0.230603 Dec 16 15:49:11.394842 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 41/81] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:11 2021] GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:49:11.446590 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-98d27655-6db0-4097-8fce-31c2da2a3a7c tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:11.447196 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-98d27655-6db0-4097-8fce-31c2da2a3a7c tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:11.453187 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-98d27655-6db0-4097-8fce-31c2da2a3a7c tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:11.453656 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-98d27655-6db0-4097-8fce-31c2da2a3a7c tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:11.454429 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-98d27655-6db0-4097-8fce-31c2da2a3a7c tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:11.454854 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-98d27655-6db0-4097-8fce-31c2da2a3a7c tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:11.456681 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-f6c8cbec-06a1-4530-95c1-9293d5a990eb tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:11.465220 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-f6c8cbec-06a1-4530-95c1-9293d5a990eb tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1321 microversion: 2.1 time: 0.189217 Dec 16 15:49:11.465801 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 41/82] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:11 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:11.584929 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-98d27655-6db0-4097-8fce-31c2da2a3a7c tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13254b92b9e94bda88f0881524ae26bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5edb8b1d36e4f01bc38f277910faf05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:11.592949 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-98d27655-6db0-4097-8fce-31c2da2a3a7c tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 200 len: 1314 microversion: 2.1 time: 0.150095 Dec 16 15:49:11.593885 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 42/83] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:11 2021] GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:12.285865 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-5793a336-d510-45fb-9377-2c0d27208ce9 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:12.286436 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-5793a336-d510-45fb-9377-2c0d27208ce9 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:12.293035 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5793a336-d510-45fb-9377-2c0d27208ce9 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:12.293608 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5793a336-d510-45fb-9377-2c0d27208ce9 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:12.294419 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5793a336-d510-45fb-9377-2c0d27208ce9 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:12.294852 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5793a336-d510-45fb-9377-2c0d27208ce9 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:12.409856 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-37a62ce3-d1da-49da-a585-3c38acb2b7cc tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:12.410466 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-37a62ce3-d1da-49da-a585-3c38acb2b7cc tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:12.416707 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-37a62ce3-d1da-49da-a585-3c38acb2b7cc tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:12.417149 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-37a62ce3-d1da-49da-a585-3c38acb2b7cc tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:12.417960 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-37a62ce3-d1da-49da-a585-3c38acb2b7cc tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:12.418384 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-37a62ce3-d1da-49da-a585-3c38acb2b7cc tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:12.438379 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-5793a336-d510-45fb-9377-2c0d27208ce9 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:12.446939 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-5793a336-d510-45fb-9377-2c0d27208ce9 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1361 microversion: 2.1 time: 0.164788 Dec 16 15:49:12.452764 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 42/84] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:12 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:12.482511 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-5d5167cf-048c-4ef6-b162-dc87b2ccaea6 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:12.483151 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-5d5167cf-048c-4ef6-b162-dc87b2ccaea6 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:12.489105 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5d5167cf-048c-4ef6-b162-dc87b2ccaea6 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:12.489596 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5d5167cf-048c-4ef6-b162-dc87b2ccaea6 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:12.490351 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5d5167cf-048c-4ef6-b162-dc87b2ccaea6 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:12.490788 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5d5167cf-048c-4ef6-b162-dc87b2ccaea6 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:12.583971 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-37a62ce3-d1da-49da-a585-3c38acb2b7cc tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:12.592069 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-37a62ce3-d1da-49da-a585-3c38acb2b7cc tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc" status: 200 len: 1318 microversion: 2.1 time: 0.185859 Dec 16 15:49:12.592656 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 43/85] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:12 2021] GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:12.612940 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-36d15a7e-c14e-4898-9804-93f79759628e tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:12.613549 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-36d15a7e-c14e-4898-9804-93f79759628e tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:12.620059 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-36d15a7e-c14e-4898-9804-93f79759628e tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:12.620518 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-36d15a7e-c14e-4898-9804-93f79759628e tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:12.621293 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-36d15a7e-c14e-4898-9804-93f79759628e tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:12.621764 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-36d15a7e-c14e-4898-9804-93f79759628e tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:12.646949 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-5d5167cf-048c-4ef6-b162-dc87b2ccaea6 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:12.654634 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-5d5167cf-048c-4ef6-b162-dc87b2ccaea6 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1321 microversion: 2.1 time: 0.175781 Dec 16 15:49:12.655211 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 43/86] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:12 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:12.750192 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-36d15a7e-c14e-4898-9804-93f79759628e tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13254b92b9e94bda88f0881524ae26bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5edb8b1d36e4f01bc38f277910faf05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:12.757848 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-36d15a7e-c14e-4898-9804-93f79759628e tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 200 len: 1314 microversion: 2.1 time: 0.148410 Dec 16 15:49:12.758404 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 44/87] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:12 2021] GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:13.141526 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-eebe71cf-d3db-4447-aab8-fa3f3b9af9fd req-7417a87d-2e9a-46e6-ae4c-50b62785e546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b15a27c-e6e3-4ac9-8882-9e52028c3bbd", "name": "network-vif-plugged", "status": "completed", "tag": "f5b55a14-2204-4e1f-a1f9-794314afd998"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:13.143149 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:49:13.143149 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:49:13.150133 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-eebe71cf-d3db-4447-aab8-fa3f3b9af9fd req-7417a87d-2e9a-46e6-ae4c-50b62785e546 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:13.150574 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-eebe71cf-d3db-4447-aab8-fa3f3b9af9fd req-7417a87d-2e9a-46e6-ae4c-50b62785e546 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:13.161565 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-eebe71cf-d3db-4447-aab8-fa3f3b9af9fd req-7417a87d-2e9a-46e6-ae4c-50b62785e546 service nova] Creating event network-vif-plugged:f5b55a14-2204-4e1f-a1f9-794314afd998 for instance 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd on hv-cinder-78447 Dec 16 15:49:13.166583 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-eebe71cf-d3db-4447-aab8-fa3f3b9af9fd req-7417a87d-2e9a-46e6-ae4c-50b62785e546 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084704 Dec 16 15:49:13.167152 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 44/88] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:49:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:49:13.467681 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-4056d8f4-9ba6-4707-b722-2174556a2c41 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:13.468713 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-4056d8f4-9ba6-4707-b722-2174556a2c41 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:13.479631 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4056d8f4-9ba6-4707-b722-2174556a2c41 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:13.480371 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4056d8f4-9ba6-4707-b722-2174556a2c41 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:13.481981 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4056d8f4-9ba6-4707-b722-2174556a2c41 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:13.482348 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4056d8f4-9ba6-4707-b722-2174556a2c41 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:13.609698 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-6868ca69-8886-4a5f-93f3-26d02a507d1d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:13.610391 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-6868ca69-8886-4a5f-93f3-26d02a507d1d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:13.616693 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6868ca69-8886-4a5f-93f3-26d02a507d1d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:13.617132 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6868ca69-8886-4a5f-93f3-26d02a507d1d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:13.617963 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6868ca69-8886-4a5f-93f3-26d02a507d1d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:13.618383 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6868ca69-8886-4a5f-93f3-26d02a507d1d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:13.621179 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-4056d8f4-9ba6-4707-b722-2174556a2c41 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:13.628750 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-4056d8f4-9ba6-4707-b722-2174556a2c41 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1361 microversion: 2.1 time: 0.167334 Dec 16 15:49:13.629426 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 45/89] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:13 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:13.671488 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-3cf32738-e15d-4a1f-8e6e-92a5a871e207 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:13.672088 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-3cf32738-e15d-4a1f-8e6e-92a5a871e207 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:13.678041 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3cf32738-e15d-4a1f-8e6e-92a5a871e207 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:13.678480 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3cf32738-e15d-4a1f-8e6e-92a5a871e207 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:13.679240 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3cf32738-e15d-4a1f-8e6e-92a5a871e207 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:13.679664 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3cf32738-e15d-4a1f-8e6e-92a5a871e207 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:13.784710 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-6868ca69-8886-4a5f-93f3-26d02a507d1d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:13.798586 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-6868ca69-8886-4a5f-93f3-26d02a507d1d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc" status: 200 len: 1318 microversion: 2.1 time: 0.192847 Dec 16 15:49:13.799549 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 45/90] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:13 2021] GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:13.812665 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-c1de2090-e3a0-4d72-a5b0-38bf42f2cfc1 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:13.813362 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-c1de2090-e3a0-4d72-a5b0-38bf42f2cfc1 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:13.820223 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c1de2090-e3a0-4d72-a5b0-38bf42f2cfc1 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:13.820666 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c1de2090-e3a0-4d72-a5b0-38bf42f2cfc1 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:13.821716 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c1de2090-e3a0-4d72-a5b0-38bf42f2cfc1 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:13.822280 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c1de2090-e3a0-4d72-a5b0-38bf42f2cfc1 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:13.981073 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-3cf32738-e15d-4a1f-8e6e-92a5a871e207 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:13.991882 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-3cf32738-e15d-4a1f-8e6e-92a5a871e207 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1321 microversion: 2.1 time: 0.323885 Dec 16 15:49:13.992634 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 46/91] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:13 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1321 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:14.155384 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-c1de2090-e3a0-4d72-a5b0-38bf42f2cfc1 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13254b92b9e94bda88f0881524ae26bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5edb8b1d36e4f01bc38f277910faf05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:14.166918 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-c1de2090-e3a0-4d72-a5b0-38bf42f2cfc1 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 200 len: 1314 microversion: 2.1 time: 0.364502 Dec 16 15:49:14.178297 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 46/92] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:13 2021] GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:14.646253 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ac2160bc-9a50-4def-9961-5d5c2b055567 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:14.647914 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-ac2160bc-9a50-4def-9961-5d5c2b055567 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:14.661008 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ac2160bc-9a50-4def-9961-5d5c2b055567 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:14.661944 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ac2160bc-9a50-4def-9961-5d5c2b055567 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:14.662906 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ac2160bc-9a50-4def-9961-5d5c2b055567 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:14.663943 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ac2160bc-9a50-4def-9961-5d5c2b055567 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:14.817030 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-16396070-caa8-41f4-b90d-3a997afa4419 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:14.817809 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-16396070-caa8-41f4-b90d-3a997afa4419 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:14.828326 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-16396070-caa8-41f4-b90d-3a997afa4419 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:14.828865 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-16396070-caa8-41f4-b90d-3a997afa4419 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:14.829894 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-16396070-caa8-41f4-b90d-3a997afa4419 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:14.830621 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-16396070-caa8-41f4-b90d-3a997afa4419 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:14.991377 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-ac2160bc-9a50-4def-9961-5d5c2b055567 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:15.011345 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-ac2160bc-9a50-4def-9961-5d5c2b055567 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1361 microversion: 2.1 time: 0.369488 Dec 16 15:49:15.015356 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 47/93] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:14 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1361 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:15.029048 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-b7ff754e-4abc-422f-815c-62712928531e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:15.039642 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-b7ff754e-4abc-422f-815c-62712928531e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:15.052933 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b7ff754e-4abc-422f-815c-62712928531e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:15.053384 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b7ff754e-4abc-422f-815c-62712928531e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:15.054257 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b7ff754e-4abc-422f-815c-62712928531e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:15.054684 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b7ff754e-4abc-422f-815c-62712928531e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:15.088684 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-16396070-caa8-41f4-b90d-3a997afa4419 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:15.096254 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-16396070-caa8-41f4-b90d-3a997afa4419 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc" status: 200 len: 1318 microversion: 2.1 time: 0.283679 Dec 16 15:49:15.105890 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 47/94] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:14 2021] GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:49:15.184852 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-9d5e661f-43ad-49b4-a7e8-281ec42b0e31 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:15.185578 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-9d5e661f-43ad-49b4-a7e8-281ec42b0e31 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:15.194903 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9d5e661f-43ad-49b4-a7e8-281ec42b0e31 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:15.195889 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9d5e661f-43ad-49b4-a7e8-281ec42b0e31 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:15.197617 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9d5e661f-43ad-49b4-a7e8-281ec42b0e31 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:15.199421 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9d5e661f-43ad-49b4-a7e8-281ec42b0e31 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:15.256952 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-b7ff754e-4abc-422f-815c-62712928531e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:15.265186 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-b7ff754e-4abc-422f-815c-62712928531e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1321 microversion: 2.1 time: 0.247413 Dec 16 15:49:15.275318 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 48/95] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:15 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:15.280425 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-b4aaafb0-e2fd-4844-9eeb-a4ee42fa5071 req-ee2ceaf5-177d-4f90-9c9c-a3d1b676ac20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "833cc951-4fe1-4d89-884f-6c98308de4bc", "name": "network-vif-plugged", "status": "completed", "tag": "83410d19-2bd0-4afe-845a-c137ecec96ca"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:15.282144 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:49:15.282144 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:49:15.293882 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-b4aaafb0-e2fd-4844-9eeb-a4ee42fa5071 req-ee2ceaf5-177d-4f90-9c9c-a3d1b676ac20 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:15.294660 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-b4aaafb0-e2fd-4844-9eeb-a4ee42fa5071 req-ee2ceaf5-177d-4f90-9c9c-a3d1b676ac20 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:15.311140 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-b4aaafb0-e2fd-4844-9eeb-a4ee42fa5071 req-ee2ceaf5-177d-4f90-9c9c-a3d1b676ac20 service nova] Creating event network-vif-plugged:83410d19-2bd0-4afe-845a-c137ecec96ca for instance 833cc951-4fe1-4d89-884f-6c98308de4bc on hv-cinder-78447 Dec 16 15:49:15.317030 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-b4aaafb0-e2fd-4844-9eeb-a4ee42fa5071 req-ee2ceaf5-177d-4f90-9c9c-a3d1b676ac20 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040510 Dec 16 15:49:15.318375 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 49/96] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:49:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:49:15.540271 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-9d5e661f-43ad-49b4-a7e8-281ec42b0e31 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13254b92b9e94bda88f0881524ae26bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5edb8b1d36e4f01bc38f277910faf05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:15.548931 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-9d5e661f-43ad-49b4-a7e8-281ec42b0e31 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 200 len: 1314 microversion: 2.1 time: 0.368289 Dec 16 15:49:15.549545 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 48/97] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:15 2021] GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:16.032630 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-af108f1c-29a7-4fef-80e9-ef12966b9d34 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:16.033334 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-af108f1c-29a7-4fef-80e9-ef12966b9d34 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:16.054060 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-af108f1c-29a7-4fef-80e9-ef12966b9d34 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:16.054622 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-af108f1c-29a7-4fef-80e9-ef12966b9d34 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:16.055484 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-af108f1c-29a7-4fef-80e9-ef12966b9d34 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:16.056055 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-af108f1c-29a7-4fef-80e9-ef12966b9d34 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:16.114782 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-e0d82a0d-5b15-4cb3-b033-3ed048ac9865 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:16.115397 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-e0d82a0d-5b15-4cb3-b033-3ed048ac9865 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:16.121718 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e0d82a0d-5b15-4cb3-b033-3ed048ac9865 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:16.122163 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e0d82a0d-5b15-4cb3-b033-3ed048ac9865 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:16.122987 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e0d82a0d-5b15-4cb3-b033-3ed048ac9865 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:16.123419 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e0d82a0d-5b15-4cb3-b033-3ed048ac9865 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:16.283962 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-af108f1c-29a7-4fef-80e9-ef12966b9d34 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:16.292681 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-af108f1c-29a7-4fef-80e9-ef12966b9d34 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1361 microversion: 2.1 time: 0.264152 Dec 16 15:49:16.293553 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 50/98] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:16 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1361 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:16.334850 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-20f91f4b-712c-41fe-96cb-5d27be3dce61 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:16.335559 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-20f91f4b-712c-41fe-96cb-5d27be3dce61 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:16.342182 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-20f91f4b-712c-41fe-96cb-5d27be3dce61 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:16.342819 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-20f91f4b-712c-41fe-96cb-5d27be3dce61 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:16.343875 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-20f91f4b-712c-41fe-96cb-5d27be3dce61 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:16.344696 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-20f91f4b-712c-41fe-96cb-5d27be3dce61 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:16.354416 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-e0d82a0d-5b15-4cb3-b033-3ed048ac9865 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:16.365543 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-e0d82a0d-5b15-4cb3-b033-3ed048ac9865 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc" status: 200 len: 1318 microversion: 2.1 time: 0.253889 Dec 16 15:49:16.377692 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 49/99] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:16 2021] GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:49:16.551498 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-20f91f4b-712c-41fe-96cb-5d27be3dce61 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:16.559660 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-20f91f4b-712c-41fe-96cb-5d27be3dce61 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1321 microversion: 2.1 time: 0.264811 Dec 16 15:49:16.563172 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 51/100] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:16 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:16.593170 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-f4f45655-501b-4d3b-b2a0-016c3f321e34 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:16.604276 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-f4f45655-501b-4d3b-b2a0-016c3f321e34 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:16.631421 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f4f45655-501b-4d3b-b2a0-016c3f321e34 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:16.632308 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f4f45655-501b-4d3b-b2a0-016c3f321e34 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:16.633864 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f4f45655-501b-4d3b-b2a0-016c3f321e34 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:16.634616 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f4f45655-501b-4d3b-b2a0-016c3f321e34 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:16.952497 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-f4f45655-501b-4d3b-b2a0-016c3f321e34 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13254b92b9e94bda88f0881524ae26bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5edb8b1d36e4f01bc38f277910faf05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:16.965509 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-f4f45655-501b-4d3b-b2a0-016c3f321e34 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 200 len: 1314 microversion: 2.1 time: 0.401831 Dec 16 15:49:16.968057 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 50/101] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:16 2021] GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:17.309176 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-42e01964-8e11-4f5d-af9c-a86100efd1e7 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:17.309907 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-42e01964-8e11-4f5d-af9c-a86100efd1e7 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:17.318098 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-42e01964-8e11-4f5d-af9c-a86100efd1e7 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:17.321982 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-42e01964-8e11-4f5d-af9c-a86100efd1e7 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:17.323100 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-42e01964-8e11-4f5d-af9c-a86100efd1e7 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:17.323725 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-42e01964-8e11-4f5d-af9c-a86100efd1e7 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:17.385281 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-7742b1ce-63aa-4bb4-89d2-bf73a6c66530 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:17.386596 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-7742b1ce-63aa-4bb4-89d2-bf73a6c66530 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:17.393315 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7742b1ce-63aa-4bb4-89d2-bf73a6c66530 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:17.396493 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7742b1ce-63aa-4bb4-89d2-bf73a6c66530 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:17.398247 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7742b1ce-63aa-4bb4-89d2-bf73a6c66530 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:17.399910 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7742b1ce-63aa-4bb4-89d2-bf73a6c66530 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:17.725796 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-42e01964-8e11-4f5d-af9c-a86100efd1e7 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:17.738018 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-7742b1ce-63aa-4bb4-89d2-bf73a6c66530 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:17.747112 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-7742b1ce-63aa-4bb4-89d2-bf73a6c66530 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc" status: 200 len: 1508 microversion: 2.1 time: 0.364359 Dec 16 15:49:17.747670 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-42e01964-8e11-4f5d-af9c-a86100efd1e7 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1361 microversion: 2.1 time: 0.441209 Dec 16 15:49:17.758074 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 51/103] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:17 2021] GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc => generated 1508 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:17.758661 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 52/103] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:17 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1361 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:17.763220 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-4d1e4e51-d82e-47da-bd29-94851c0116cd tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:17.764048 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-4d1e4e51-d82e-47da-bd29-94851c0116cd tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:17.770794 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4d1e4e51-d82e-47da-bd29-94851c0116cd tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:17.771607 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4d1e4e51-d82e-47da-bd29-94851c0116cd tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:17.772613 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4d1e4e51-d82e-47da-bd29-94851c0116cd tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:17.773194 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4d1e4e51-d82e-47da-bd29-94851c0116cd tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:17.983510 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-826379f8-411c-4176-92f3-d934848af14d tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:17.984207 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-826379f8-411c-4176-92f3-d934848af14d tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:17.997875 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-826379f8-411c-4176-92f3-d934848af14d tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:18.000111 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-826379f8-411c-4176-92f3-d934848af14d tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:18.001992 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-826379f8-411c-4176-92f3-d934848af14d tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:18.006328 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-826379f8-411c-4176-92f3-d934848af14d tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:18.047873 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-4d1e4e51-d82e-47da-bd29-94851c0116cd tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:18.061113 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-4d1e4e51-d82e-47da-bd29-94851c0116cd tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1321 microversion: 2.1 time: 0.300996 Dec 16 15:49:18.062414 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 52/104] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:17 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:18.277247 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-826379f8-411c-4176-92f3-d934848af14d tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13254b92b9e94bda88f0881524ae26bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5edb8b1d36e4f01bc38f277910faf05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:18.285452 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-826379f8-411c-4176-92f3-d934848af14d tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 200 len: 1501 microversion: 2.1 time: 0.305759 Dec 16 15:49:18.286019 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 53/105] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:17 2021] GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 1501 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:49:18.764985 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-08bf3b06-e02f-4bba-96ee-f226ce0cce63 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:18.765839 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-08bf3b06-e02f-4bba-96ee-f226ce0cce63 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:18.775015 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-08bf3b06-e02f-4bba-96ee-f226ce0cce63 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:18.777120 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-08bf3b06-e02f-4bba-96ee-f226ce0cce63 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:18.778175 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-08bf3b06-e02f-4bba-96ee-f226ce0cce63 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:18.780841 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-08bf3b06-e02f-4bba-96ee-f226ce0cce63 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:19.004320 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-08bf3b06-e02f-4bba-96ee-f226ce0cce63 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:19.016888 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-08bf3b06-e02f-4bba-96ee-f226ce0cce63 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1361 microversion: 2.1 time: 0.256114 Dec 16 15:49:19.018033 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 53/106] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:18 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1361 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:19.078717 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-c31bfce6-a4ec-4217-a811-54ae6083c7af tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:19.079490 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-c31bfce6-a4ec-4217-a811-54ae6083c7af tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:19.085826 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c31bfce6-a4ec-4217-a811-54ae6083c7af tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:19.086395 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c31bfce6-a4ec-4217-a811-54ae6083c7af tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:19.087620 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c31bfce6-a4ec-4217-a811-54ae6083c7af tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:19.088141 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c31bfce6-a4ec-4217-a811-54ae6083c7af tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:19.316233 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-c31bfce6-a4ec-4217-a811-54ae6083c7af tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:19.324964 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-c31bfce6-a4ec-4217-a811-54ae6083c7af tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1321 microversion: 2.1 time: 0.250539 Dec 16 15:49:19.325669 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 54/107] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:19 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:19.734584 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-38a440aa-ded3-43ee-9133-cecbd8f0a841 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9bc8494e-ab80-4f87-9437-b6a9f5e605d4"}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:19.735835 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-38a440aa-ded3-43ee-9133-cecbd8f0a841 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:19.741781 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-38a440aa-ded3-43ee-9133-cecbd8f0a841 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:19.742247 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-38a440aa-ded3-43ee-9133-cecbd8f0a841 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:19.743450 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-38a440aa-ded3-43ee-9133-cecbd8f0a841 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:19.743888 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-38a440aa-ded3-43ee-9133-cecbd8f0a841 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:20.034397 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-b8f4d285-b7c8-453a-96ef-127aac2cc539 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:20.035123 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-b8f4d285-b7c8-453a-96ef-127aac2cc539 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:20.044175 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b8f4d285-b7c8-453a-96ef-127aac2cc539 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:20.045867 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b8f4d285-b7c8-453a-96ef-127aac2cc539 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:20.047002 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b8f4d285-b7c8-453a-96ef-127aac2cc539 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:20.047607 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b8f4d285-b7c8-453a-96ef-127aac2cc539 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:20.148835 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-38a440aa-ded3-43ee-9133-cecbd8f0a841 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "POST /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.417813 Dec 16 15:49:20.153590 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 54/108] 10.222.0.31 () {60 vars in 1322 bytes} [Thu Dec 16 15:49:19 2021] POST /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc/os-volume_attachments => generated 194 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:49:20.166432 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-a5804302-c07e-4b3b-8e45-5db355e467f0 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8021a68c-442a-45bf-8421-c111f0059459"}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:20.168007 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-a5804302-c07e-4b3b-8e45-5db355e467f0 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:20.176455 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a5804302-c07e-4b3b-8e45-5db355e467f0 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:20.177281 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a5804302-c07e-4b3b-8e45-5db355e467f0 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:20.178306 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a5804302-c07e-4b3b-8e45-5db355e467f0 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:20.178719 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a5804302-c07e-4b3b-8e45-5db355e467f0 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:20.240104 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-b8f4d285-b7c8-453a-96ef-127aac2cc539 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:20.248421 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-b8f4d285-b7c8-453a-96ef-127aac2cc539 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1361 microversion: 2.1 time: 0.217594 Dec 16 15:49:20.258279 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 55/109] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:20 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1361 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:20.342685 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ea8b7319-cb52-499d-9f0b-3f73bead0d59 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:20.343647 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-ea8b7319-cb52-499d-9f0b-3f73bead0d59 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:20.351191 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ea8b7319-cb52-499d-9f0b-3f73bead0d59 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:20.351850 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ea8b7319-cb52-499d-9f0b-3f73bead0d59 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:20.353440 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ea8b7319-cb52-499d-9f0b-3f73bead0d59 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:20.354083 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ea8b7319-cb52-499d-9f0b-3f73bead0d59 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:20.574515 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-ea8b7319-cb52-499d-9f0b-3f73bead0d59 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:20.582466 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-ea8b7319-cb52-499d-9f0b-3f73bead0d59 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1321 microversion: 2.1 time: 0.244381 Dec 16 15:49:20.593215 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 56/110] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:20 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:49:20.849151 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-a5804302-c07e-4b3b-8e45-5db355e467f0 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "POST /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.692822 Dec 16 15:49:20.850705 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 55/111] 10.222.0.31 () {60 vars in 1322 bytes} [Thu Dec 16 15:49:20 2021] POST /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd/os-volume_attachments => generated 194 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:49:21.023271 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-5aa1bd60-8a46-4ee9-8491-364a557b0c21 req-1f9e92a6-7f46-48ca-8d2e-a00dd0636a71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce6f3e72-0124-4937-9016-c13d65d07acd", "name": "network-vif-plugged", "status": "completed", "tag": "cc1f207a-64d8-409d-a59e-543c8d2230c6"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:21.024862 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:49:21.024862 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:49:21.034705 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-5aa1bd60-8a46-4ee9-8491-364a557b0c21 req-1f9e92a6-7f46-48ca-8d2e-a00dd0636a71 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:21.035162 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-5aa1bd60-8a46-4ee9-8491-364a557b0c21 req-1f9e92a6-7f46-48ca-8d2e-a00dd0636a71 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:21.049249 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-5aa1bd60-8a46-4ee9-8491-364a557b0c21 req-1f9e92a6-7f46-48ca-8d2e-a00dd0636a71 service nova] Creating event network-vif-plugged:cc1f207a-64d8-409d-a59e-543c8d2230c6 for instance ce6f3e72-0124-4937-9016-c13d65d07acd on hv-cinder-78447 Dec 16 15:49:21.055692 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-5aa1bd60-8a46-4ee9-8491-364a557b0c21 req-1f9e92a6-7f46-48ca-8d2e-a00dd0636a71 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036984 Dec 16 15:49:21.056614 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 57/112] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:49:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:49:21.266542 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-a088e129-b6ad-47d2-817e-e38864ca9cba tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:21.267435 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-a088e129-b6ad-47d2-817e-e38864ca9cba tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:21.283357 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a088e129-b6ad-47d2-817e-e38864ca9cba tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:21.284009 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a088e129-b6ad-47d2-817e-e38864ca9cba tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:21.286177 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a088e129-b6ad-47d2-817e-e38864ca9cba tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:21.286723 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a088e129-b6ad-47d2-817e-e38864ca9cba tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:21.525800 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-a088e129-b6ad-47d2-817e-e38864ca9cba tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:21.536629 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-a088e129-b6ad-47d2-817e-e38864ca9cba tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1361 microversion: 2.1 time: 0.273921 Dec 16 15:49:21.546309 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 56/113] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:21 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1361 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:21.600676 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-3ca83802-9505-406a-8c6e-1a54e43ae486 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:21.601321 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-3ca83802-9505-406a-8c6e-1a54e43ae486 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:21.607839 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3ca83802-9505-406a-8c6e-1a54e43ae486 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:21.609140 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3ca83802-9505-406a-8c6e-1a54e43ae486 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:21.610457 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3ca83802-9505-406a-8c6e-1a54e43ae486 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:21.610795 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3ca83802-9505-406a-8c6e-1a54e43ae486 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:21.859484 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-3ca83802-9505-406a-8c6e-1a54e43ae486 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:21.866959 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-3ca83802-9505-406a-8c6e-1a54e43ae486 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1321 microversion: 2.1 time: 0.270500 Dec 16 15:49:21.867883 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 58/114] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:21 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:49:22.556463 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-e56252f2-8aeb-4bf4-8dd9-6a4ecd2642b7 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:22.557998 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-e56252f2-8aeb-4bf4-8dd9-6a4ecd2642b7 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:22.567078 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e56252f2-8aeb-4bf4-8dd9-6a4ecd2642b7 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:22.567583 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e56252f2-8aeb-4bf4-8dd9-6a4ecd2642b7 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:22.568718 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e56252f2-8aeb-4bf4-8dd9-6a4ecd2642b7 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:22.569472 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e56252f2-8aeb-4bf4-8dd9-6a4ecd2642b7 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:22.774498 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-e56252f2-8aeb-4bf4-8dd9-6a4ecd2642b7 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:22.785177 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-e56252f2-8aeb-4bf4-8dd9-6a4ecd2642b7 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1361 microversion: 2.1 time: 0.234735 Dec 16 15:49:22.785809 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 57/115] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:22 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1361 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:22.883481 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-9aa4d3e0-9246-4311-bdaa-96eaf8e9a721 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:22.884087 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-9aa4d3e0-9246-4311-bdaa-96eaf8e9a721 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:22.890154 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9aa4d3e0-9246-4311-bdaa-96eaf8e9a721 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:22.890610 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9aa4d3e0-9246-4311-bdaa-96eaf8e9a721 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:22.891399 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9aa4d3e0-9246-4311-bdaa-96eaf8e9a721 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:22.891829 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9aa4d3e0-9246-4311-bdaa-96eaf8e9a721 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:23.062904 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-9aa4d3e0-9246-4311-bdaa-96eaf8e9a721 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:23.068946 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-9aa4d3e0-9246-4311-bdaa-96eaf8e9a721 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1321 microversion: 2.1 time: 0.189111 Dec 16 15:49:23.079047 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 59/116] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:22 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:49:23.086505 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-eba195a4-78ca-48e8-ae23-abd378630723 req-8e02f790-c58a-480d-a781-236d477494c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29bba044-2e01-44b1-bb03-0f367846a5f0", "name": "network-vif-plugged", "status": "completed", "tag": "1b9973de-48e3-4cb5-a15d-7bd646981f14"}, {"server_uuid": "05750574-60a7-44f6-8fd6-d2fd52b57e91", "name": "network-vif-plugged", "status": "completed", "tag": "a162fcff-3fe8-4fc6-a489-b53c84cb0c45"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:23.088655 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:49:23.088655 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:49:23.106789 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-eba195a4-78ca-48e8-ae23-abd378630723 req-8e02f790-c58a-480d-a781-236d477494c1 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:23.107058 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-eba195a4-78ca-48e8-ae23-abd378630723 req-8e02f790-c58a-480d-a781-236d477494c1 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:23.133696 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-eba195a4-78ca-48e8-ae23-abd378630723 req-8e02f790-c58a-480d-a781-236d477494c1 service nova] Creating event network-vif-plugged:1b9973de-48e3-4cb5-a15d-7bd646981f14 for instance 29bba044-2e01-44b1-bb03-0f367846a5f0 on hv-cinder-78447 Dec 16 15:49:23.134218 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-eba195a4-78ca-48e8-ae23-abd378630723 req-8e02f790-c58a-480d-a781-236d477494c1 service nova] Creating event network-vif-plugged:a162fcff-3fe8-4fc6-a489-b53c84cb0c45 for instance 05750574-60a7-44f6-8fd6-d2fd52b57e91 on hv-cinder-78447 Dec 16 15:49:23.143437 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-eba195a4-78ca-48e8-ae23-abd378630723 req-8e02f790-c58a-480d-a781-236d477494c1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.061907 Dec 16 15:49:23.144353 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 58/117] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:49:23 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:49:23.801995 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-d5542de3-2bfa-4b3b-84c5-2529652c7cfb tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:23.802718 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-d5542de3-2bfa-4b3b-84c5-2529652c7cfb tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:23.809292 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d5542de3-2bfa-4b3b-84c5-2529652c7cfb tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:23.809970 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d5542de3-2bfa-4b3b-84c5-2529652c7cfb tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:23.810895 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d5542de3-2bfa-4b3b-84c5-2529652c7cfb tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:23.811720 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d5542de3-2bfa-4b3b-84c5-2529652c7cfb tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:23.955219 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-d5542de3-2bfa-4b3b-84c5-2529652c7cfb tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:23.963975 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-d5542de3-2bfa-4b3b-84c5-2529652c7cfb tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1361 microversion: 2.1 time: 0.165487 Dec 16 15:49:23.964970 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 60/118] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:23 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:24.087271 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-de559aa0-0018-434c-86a0-5886e9845b99 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:24.087975 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-de559aa0-0018-434c-86a0-5886e9845b99 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:24.094163 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-de559aa0-0018-434c-86a0-5886e9845b99 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:24.094874 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-de559aa0-0018-434c-86a0-5886e9845b99 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:24.095664 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-de559aa0-0018-434c-86a0-5886e9845b99 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:24.096306 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-de559aa0-0018-434c-86a0-5886e9845b99 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:24.241560 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-de559aa0-0018-434c-86a0-5886e9845b99 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:24.249863 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-de559aa0-0018-434c-86a0-5886e9845b99 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1321 microversion: 2.1 time: 0.166346 Dec 16 15:49:24.250448 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 59/119] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:24 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:24.981550 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-1e6c5e02-d6b1-4671-8d96-1f245bfe3777 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:24.982942 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-1e6c5e02-d6b1-4671-8d96-1f245bfe3777 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:24.989247 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1e6c5e02-d6b1-4671-8d96-1f245bfe3777 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:24.989700 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1e6c5e02-d6b1-4671-8d96-1f245bfe3777 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:24.990537 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1e6c5e02-d6b1-4671-8d96-1f245bfe3777 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:24.990967 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1e6c5e02-d6b1-4671-8d96-1f245bfe3777 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:25.146294 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-1e6c5e02-d6b1-4671-8d96-1f245bfe3777 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:25.154711 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-1e6c5e02-d6b1-4671-8d96-1f245bfe3777 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1361 microversion: 2.1 time: 0.177543 Dec 16 15:49:25.155306 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 61/120] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:24 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:25.270050 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-fbfa04a1-dde5-4cd5-ae5a-f446e9f3410d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:25.271333 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-fbfa04a1-dde5-4cd5-ae5a-f446e9f3410d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:25.287129 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-fbfa04a1-dde5-4cd5-ae5a-f446e9f3410d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:25.288082 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-fbfa04a1-dde5-4cd5-ae5a-f446e9f3410d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:25.291157 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-fbfa04a1-dde5-4cd5-ae5a-f446e9f3410d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:25.291959 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-fbfa04a1-dde5-4cd5-ae5a-f446e9f3410d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:25.580304 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-fbfa04a1-dde5-4cd5-ae5a-f446e9f3410d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:25.591225 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-fbfa04a1-dde5-4cd5-ae5a-f446e9f3410d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1321 microversion: 2.1 time: 0.326626 Dec 16 15:49:25.600983 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 60/121] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:25 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1321 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:26.172439 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-4fedb2c7-491a-413f-853a-f352ad7d35a9 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:26.173221 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-4fedb2c7-491a-413f-853a-f352ad7d35a9 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:26.179917 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4fedb2c7-491a-413f-853a-f352ad7d35a9 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:26.180382 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4fedb2c7-491a-413f-853a-f352ad7d35a9 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:26.181165 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4fedb2c7-491a-413f-853a-f352ad7d35a9 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:26.181654 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4fedb2c7-491a-413f-853a-f352ad7d35a9 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:26.316565 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-4fedb2c7-491a-413f-853a-f352ad7d35a9 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:26.324194 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-4fedb2c7-491a-413f-853a-f352ad7d35a9 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1361 microversion: 2.1 time: 0.155544 Dec 16 15:49:26.324722 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 62/122] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:26 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:26.608282 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-d4b851e2-edaa-442f-8a9d-eadce5cc2734 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:26.608876 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-d4b851e2-edaa-442f-8a9d-eadce5cc2734 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:26.615349 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d4b851e2-edaa-442f-8a9d-eadce5cc2734 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:26.615774 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d4b851e2-edaa-442f-8a9d-eadce5cc2734 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:26.616563 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d4b851e2-edaa-442f-8a9d-eadce5cc2734 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:26.617062 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d4b851e2-edaa-442f-8a9d-eadce5cc2734 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:26.765719 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-d4b851e2-edaa-442f-8a9d-eadce5cc2734 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:26.774081 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-d4b851e2-edaa-442f-8a9d-eadce5cc2734 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1515 microversion: 2.1 time: 0.169510 Dec 16 15:49:26.774639 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 61/123] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:26 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:26.790539 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-1e6c0240-1768-4f46-bfe7-fc4be022c727 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:26.791514 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-1e6c0240-1768-4f46-bfe7-fc4be022c727 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:26.797660 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1e6c0240-1768-4f46-bfe7-fc4be022c727 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:26.798105 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1e6c0240-1768-4f46-bfe7-fc4be022c727 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:26.798875 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1e6c0240-1768-4f46-bfe7-fc4be022c727 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:26.799300 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1e6c0240-1768-4f46-bfe7-fc4be022c727 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:26.858684 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.objects.instance [None req-1e6c0240-1768-4f46-bfe7-fc4be022c727 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lazy-loading 'flavor' on Instance uuid ce6f3e72-0124-4937-9016-c13d65d07acd {{(pid=122399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:49:26.981981 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-1e6c0240-1768-4f46-bfe7-fc4be022c727 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "POST /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd/action" status: 200 len: 32 microversion: 2.1 time: 0.195137 Dec 16 15:49:26.982583 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 63/124] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:49:26 2021] POST /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd/action => generated 32 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:49:26.993550 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-666a3b11-63bf-4362-a05e-c22e08c5c03b tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:26.994195 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-666a3b11-63bf-4362-a05e-c22e08c5c03b tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:27.000615 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-666a3b11-63bf-4362-a05e-c22e08c5c03b tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:27.001071 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-666a3b11-63bf-4362-a05e-c22e08c5c03b tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:27.001891 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-666a3b11-63bf-4362-a05e-c22e08c5c03b tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:27.002325 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-666a3b11-63bf-4362-a05e-c22e08c5c03b tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:27.138570 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-666a3b11-63bf-4362-a05e-c22e08c5c03b tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:27.146500 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-666a3b11-63bf-4362-a05e-c22e08c5c03b tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1521 microversion: 2.1 time: 0.158406 Dec 16 15:49:27.147153 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 62/125] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:26 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:27.344722 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-c3a74739-e8e7-42bc-8c3f-e33a3621627a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:27.345927 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-c3a74739-e8e7-42bc-8c3f-e33a3621627a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:27.354675 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c3a74739-e8e7-42bc-8c3f-e33a3621627a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:27.355118 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c3a74739-e8e7-42bc-8c3f-e33a3621627a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:27.355885 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c3a74739-e8e7-42bc-8c3f-e33a3621627a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:27.356336 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c3a74739-e8e7-42bc-8c3f-e33a3621627a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:27.508581 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-c3a74739-e8e7-42bc-8c3f-e33a3621627a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:27.516225 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-c3a74739-e8e7-42bc-8c3f-e33a3621627a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1361 microversion: 2.1 time: 0.177568 Dec 16 15:49:27.516823 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 64/126] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:27 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:28.167347 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-2019a87f-4843-4eb7-a409-0ffecdfca66a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:28.168212 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-2019a87f-4843-4eb7-a409-0ffecdfca66a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:28.178073 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2019a87f-4843-4eb7-a409-0ffecdfca66a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:28.178698 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2019a87f-4843-4eb7-a409-0ffecdfca66a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:28.179950 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2019a87f-4843-4eb7-a409-0ffecdfca66a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:28.180571 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2019a87f-4843-4eb7-a409-0ffecdfca66a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:28.315934 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-2019a87f-4843-4eb7-a409-0ffecdfca66a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:28.325630 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-2019a87f-4843-4eb7-a409-0ffecdfca66a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1521 microversion: 2.1 time: 0.163795 Dec 16 15:49:28.326343 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 63/127] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:28 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:28.533741 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-28c0dd51-9952-4801-80f3-25f4722fe9ee tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:28.534324 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-28c0dd51-9952-4801-80f3-25f4722fe9ee tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:28.543055 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-28c0dd51-9952-4801-80f3-25f4722fe9ee tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:28.543665 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-28c0dd51-9952-4801-80f3-25f4722fe9ee tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:28.544750 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-28c0dd51-9952-4801-80f3-25f4722fe9ee tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:28.545301 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-28c0dd51-9952-4801-80f3-25f4722fe9ee tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:28.686099 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-28c0dd51-9952-4801-80f3-25f4722fe9ee tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:28.693517 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-28c0dd51-9952-4801-80f3-25f4722fe9ee tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1361 microversion: 2.1 time: 0.163559 Dec 16 15:49:28.694091 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 65/128] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:28 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:29.342996 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-a4faf716-e517-44a9-873c-ce02bbe53eaf tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:29.343587 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-a4faf716-e517-44a9-873c-ce02bbe53eaf tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:29.350297 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a4faf716-e517-44a9-873c-ce02bbe53eaf tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:29.350760 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a4faf716-e517-44a9-873c-ce02bbe53eaf tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:29.351523 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a4faf716-e517-44a9-873c-ce02bbe53eaf tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:29.352318 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a4faf716-e517-44a9-873c-ce02bbe53eaf tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:29.494732 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-a4faf716-e517-44a9-873c-ce02bbe53eaf tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:29.502545 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-a4faf716-e517-44a9-873c-ce02bbe53eaf tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1521 microversion: 2.1 time: 0.163195 Dec 16 15:49:29.503121 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 64/129] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:29 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:29.710108 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-4249cf61-4a53-4c7b-b50c-cc0b36006cb5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:29.710822 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-4249cf61-4a53-4c7b-b50c-cc0b36006cb5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:29.717137 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4249cf61-4a53-4c7b-b50c-cc0b36006cb5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:29.717619 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4249cf61-4a53-4c7b-b50c-cc0b36006cb5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:29.718397 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4249cf61-4a53-4c7b-b50c-cc0b36006cb5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:29.718924 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4249cf61-4a53-4c7b-b50c-cc0b36006cb5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:29.859845 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-4249cf61-4a53-4c7b-b50c-cc0b36006cb5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:29.867396 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-4249cf61-4a53-4c7b-b50c-cc0b36006cb5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1361 microversion: 2.1 time: 0.160951 Dec 16 15:49:29.877129 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 66/130] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:29 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:30.519428 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-65aaf8fd-70df-40f4-b44e-d4fb8042dbe3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:30.520043 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-65aaf8fd-70df-40f4-b44e-d4fb8042dbe3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:30.526724 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-65aaf8fd-70df-40f4-b44e-d4fb8042dbe3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:30.527238 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-65aaf8fd-70df-40f4-b44e-d4fb8042dbe3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:30.527957 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-65aaf8fd-70df-40f4-b44e-d4fb8042dbe3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:30.528392 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-65aaf8fd-70df-40f4-b44e-d4fb8042dbe3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:30.663025 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-65aaf8fd-70df-40f4-b44e-d4fb8042dbe3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:30.671214 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-65aaf8fd-70df-40f4-b44e-d4fb8042dbe3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1521 microversion: 2.1 time: 0.155585 Dec 16 15:49:30.671780 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 65/131] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:30 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:30.884188 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-2dde3cb2-e56d-4559-9d9e-759c62521132 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:30.884753 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-2dde3cb2-e56d-4559-9d9e-759c62521132 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:30.891307 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2dde3cb2-e56d-4559-9d9e-759c62521132 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:30.891753 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2dde3cb2-e56d-4559-9d9e-759c62521132 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:30.892526 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2dde3cb2-e56d-4559-9d9e-759c62521132 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:30.892959 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2dde3cb2-e56d-4559-9d9e-759c62521132 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:31.027023 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-2dde3cb2-e56d-4559-9d9e-759c62521132 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:31.034660 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-2dde3cb2-e56d-4559-9d9e-759c62521132 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1361 microversion: 2.1 time: 0.154166 Dec 16 15:49:31.035201 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 67/132] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:30 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:31.688176 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-0e0132c7-03af-4828-8b61-08dc8d99a94f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:31.688888 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-0e0132c7-03af-4828-8b61-08dc8d99a94f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:31.696000 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0e0132c7-03af-4828-8b61-08dc8d99a94f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:31.696501 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0e0132c7-03af-4828-8b61-08dc8d99a94f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:31.697279 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0e0132c7-03af-4828-8b61-08dc8d99a94f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:31.697663 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0e0132c7-03af-4828-8b61-08dc8d99a94f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:31.835628 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-0e0132c7-03af-4828-8b61-08dc8d99a94f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:31.847863 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-0e0132c7-03af-4828-8b61-08dc8d99a94f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1521 microversion: 2.1 time: 0.163042 Dec 16 15:49:31.848771 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 66/133] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:31 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:32.050344 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ab989e0a-abea-4aa2-9b57-98f5a77c5562 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:32.050966 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-ab989e0a-abea-4aa2-9b57-98f5a77c5562 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:32.057564 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ab989e0a-abea-4aa2-9b57-98f5a77c5562 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:32.058015 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ab989e0a-abea-4aa2-9b57-98f5a77c5562 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:32.058793 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ab989e0a-abea-4aa2-9b57-98f5a77c5562 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:32.059226 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ab989e0a-abea-4aa2-9b57-98f5a77c5562 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:32.203895 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-ab989e0a-abea-4aa2-9b57-98f5a77c5562 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:32.212001 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-ab989e0a-abea-4aa2-9b57-98f5a77c5562 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1361 microversion: 2.1 time: 0.165218 Dec 16 15:49:32.212502 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 68/134] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:32 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:32.869430 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-ccc65e42-bd47-47ed-b142-f9000ec70768 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:32.870070 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-ccc65e42-bd47-47ed-b142-f9000ec70768 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:32.876532 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ccc65e42-bd47-47ed-b142-f9000ec70768 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:32.876978 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ccc65e42-bd47-47ed-b142-f9000ec70768 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:32.877782 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ccc65e42-bd47-47ed-b142-f9000ec70768 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:32.878214 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ccc65e42-bd47-47ed-b142-f9000ec70768 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:33.016003 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-ccc65e42-bd47-47ed-b142-f9000ec70768 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:33.023622 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-ccc65e42-bd47-47ed-b142-f9000ec70768 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1521 microversion: 2.1 time: 0.157964 Dec 16 15:49:33.024196 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 67/135] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:32 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:33.233188 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-08298837-fe10-4825-a533-cf18b5d2d261 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:33.234172 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-08298837-fe10-4825-a533-cf18b5d2d261 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:33.244417 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-08298837-fe10-4825-a533-cf18b5d2d261 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:33.245144 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-08298837-fe10-4825-a533-cf18b5d2d261 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:33.245953 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-08298837-fe10-4825-a533-cf18b5d2d261 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:33.246382 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-08298837-fe10-4825-a533-cf18b5d2d261 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:33.387703 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-08298837-fe10-4825-a533-cf18b5d2d261 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:33.395504 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-08298837-fe10-4825-a533-cf18b5d2d261 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1361 microversion: 2.1 time: 0.168861 Dec 16 15:49:33.396071 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 69/136] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:33 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:34.039988 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-3c189bae-5072-4744-95af-fc8f5caa629e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:34.040697 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-3c189bae-5072-4744-95af-fc8f5caa629e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:34.047257 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3c189bae-5072-4744-95af-fc8f5caa629e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:34.047750 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3c189bae-5072-4744-95af-fc8f5caa629e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:34.048606 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3c189bae-5072-4744-95af-fc8f5caa629e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:34.049073 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3c189bae-5072-4744-95af-fc8f5caa629e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:34.198354 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-3c189bae-5072-4744-95af-fc8f5caa629e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:34.206620 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-3c189bae-5072-4744-95af-fc8f5caa629e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1521 microversion: 2.1 time: 0.170448 Dec 16 15:49:34.207484 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 68/137] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:34 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:34.416587 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-0c85c890-4a45-4c2f-9bbf-ad57f1d7d932 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:34.417485 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-0c85c890-4a45-4c2f-9bbf-ad57f1d7d932 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:34.424759 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0c85c890-4a45-4c2f-9bbf-ad57f1d7d932 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:34.425259 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0c85c890-4a45-4c2f-9bbf-ad57f1d7d932 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:34.426143 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0c85c890-4a45-4c2f-9bbf-ad57f1d7d932 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:34.426623 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0c85c890-4a45-4c2f-9bbf-ad57f1d7d932 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:34.565246 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-0c85c890-4a45-4c2f-9bbf-ad57f1d7d932 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:34.572945 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-0c85c890-4a45-4c2f-9bbf-ad57f1d7d932 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1361 microversion: 2.1 time: 0.162963 Dec 16 15:49:34.573516 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 70/138] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:34 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:35.224956 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-7fc3545d-6846-4ec9-b6f3-bfda6dd5b14a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:35.225711 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-7fc3545d-6846-4ec9-b6f3-bfda6dd5b14a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:35.233179 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7fc3545d-6846-4ec9-b6f3-bfda6dd5b14a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:35.233667 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7fc3545d-6846-4ec9-b6f3-bfda6dd5b14a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:35.234447 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7fc3545d-6846-4ec9-b6f3-bfda6dd5b14a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:35.234878 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7fc3545d-6846-4ec9-b6f3-bfda6dd5b14a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:35.368052 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-7fc3545d-6846-4ec9-b6f3-bfda6dd5b14a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:35.375927 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-7fc3545d-6846-4ec9-b6f3-bfda6dd5b14a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1521 microversion: 2.1 time: 0.155322 Dec 16 15:49:35.376475 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 69/139] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:35 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:35.591519 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-7adfb25d-b171-4821-8fe5-86769f29640e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:35.592358 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-7adfb25d-b171-4821-8fe5-86769f29640e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:35.601778 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7adfb25d-b171-4821-8fe5-86769f29640e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:35.602770 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7adfb25d-b171-4821-8fe5-86769f29640e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:35.603871 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7adfb25d-b171-4821-8fe5-86769f29640e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:35.604481 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7adfb25d-b171-4821-8fe5-86769f29640e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:35.745843 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-7adfb25d-b171-4821-8fe5-86769f29640e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:35.753960 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-7adfb25d-b171-4821-8fe5-86769f29640e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1361 microversion: 2.1 time: 0.166912 Dec 16 15:49:35.754593 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 71/140] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:35 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:36.396981 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-32de36f2-b920-4422-a9a7-0a11a15ddcc0 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:36.397989 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-32de36f2-b920-4422-a9a7-0a11a15ddcc0 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:36.408552 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-32de36f2-b920-4422-a9a7-0a11a15ddcc0 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:36.409294 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-32de36f2-b920-4422-a9a7-0a11a15ddcc0 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:36.410634 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-32de36f2-b920-4422-a9a7-0a11a15ddcc0 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:36.411349 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-32de36f2-b920-4422-a9a7-0a11a15ddcc0 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:36.548735 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-32de36f2-b920-4422-a9a7-0a11a15ddcc0 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:36.556215 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-32de36f2-b920-4422-a9a7-0a11a15ddcc0 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1521 microversion: 2.1 time: 0.165474 Dec 16 15:49:36.557101 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 70/141] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:36 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:36.775143 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-82583ed0-fe5f-4c67-be3a-290160b47296 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:36.776121 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-82583ed0-fe5f-4c67-be3a-290160b47296 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:36.783132 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-82583ed0-fe5f-4c67-be3a-290160b47296 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:36.783572 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-82583ed0-fe5f-4c67-be3a-290160b47296 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:36.784328 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-82583ed0-fe5f-4c67-be3a-290160b47296 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:36.785037 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-82583ed0-fe5f-4c67-be3a-290160b47296 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:36.917532 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-82583ed0-fe5f-4c67-be3a-290160b47296 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:36.924804 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-82583ed0-fe5f-4c67-be3a-290160b47296 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1361 microversion: 2.1 time: 0.155409 Dec 16 15:49:36.925364 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 72/142] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:36 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:37.573222 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-2057cd25-300e-4a37-aae3-e98a79456dc4 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:37.573848 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-2057cd25-300e-4a37-aae3-e98a79456dc4 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:37.580604 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2057cd25-300e-4a37-aae3-e98a79456dc4 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:37.581077 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2057cd25-300e-4a37-aae3-e98a79456dc4 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:37.581981 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2057cd25-300e-4a37-aae3-e98a79456dc4 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:37.582466 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2057cd25-300e-4a37-aae3-e98a79456dc4 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:37.723120 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-2057cd25-300e-4a37-aae3-e98a79456dc4 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:37.731792 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-2057cd25-300e-4a37-aae3-e98a79456dc4 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1521 microversion: 2.1 time: 0.162302 Dec 16 15:49:37.732390 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 71/143] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:37 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:37.944958 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-0290abfa-0b39-47f0-8838-221cdf9fc403 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:37.945671 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-0290abfa-0b39-47f0-8838-221cdf9fc403 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:37.951832 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0290abfa-0b39-47f0-8838-221cdf9fc403 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:37.952278 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0290abfa-0b39-47f0-8838-221cdf9fc403 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:37.953058 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0290abfa-0b39-47f0-8838-221cdf9fc403 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:37.953530 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0290abfa-0b39-47f0-8838-221cdf9fc403 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:38.093515 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-0290abfa-0b39-47f0-8838-221cdf9fc403 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:38.102746 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-0290abfa-0b39-47f0-8838-221cdf9fc403 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1547 microversion: 2.1 time: 0.161662 Dec 16 15:49:38.103323 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 73/144] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:37 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1547 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:38.119842 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-f7817ea7-f792-4f08-9ae8-5147e25b6790 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:38.120337 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-f7817ea7-f792-4f08-9ae8-5147e25b6790 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:38.127479 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f7817ea7-f792-4f08-9ae8-5147e25b6790 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:38.127966 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f7817ea7-f792-4f08-9ae8-5147e25b6790 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:38.128777 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f7817ea7-f792-4f08-9ae8-5147e25b6790 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:38.129200 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f7817ea7-f792-4f08-9ae8-5147e25b6790 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:38.213872 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-f7817ea7-f792-4f08-9ae8-5147e25b6790 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097940 Dec 16 15:49:38.214720 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 72/145] 10.222.0.31 () {58 vars in 1274 bytes} [Thu Dec 16 15:49:38 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:49:38.529085 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-2297fe8d-8486-490f-9410-7f8aee9ee86f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-875688012", "imageRef": "2a1434ad-0c2c-4725-baad-a605624baf01", "flavorRef": "452", "networks": [{"uuid": "4e96172c-0b71-4de2-95ab-4226e7a02984"}]}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:38.579087 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.network.neutron [None req-2297fe8d-8486-490f-9410-7f8aee9ee86f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] validate_networks() for [('4e96172c-0b71-4de2-95ab-4226e7a02984', None, None, None, None, None)] {{(pid=122399) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 15:49:38.749387 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-0e534440-3e01-4f0c-a2d8-c9bfdb6845c4 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:38.751176 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-0e534440-3e01-4f0c-a2d8-c9bfdb6845c4 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:38.757262 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0e534440-3e01-4f0c-a2d8-c9bfdb6845c4 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:38.757607 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0e534440-3e01-4f0c-a2d8-c9bfdb6845c4 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:38.758554 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0e534440-3e01-4f0c-a2d8-c9bfdb6845c4 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:38.759185 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0e534440-3e01-4f0c-a2d8-c9bfdb6845c4 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:39.043734 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-0e534440-3e01-4f0c-a2d8-c9bfdb6845c4 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:39.064776 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-0e534440-3e01-4f0c-a2d8-c9bfdb6845c4 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1521 microversion: 2.1 time: 0.315867 Dec 16 15:49:39.066011 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 73/146] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:38 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:49:39.092969 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-2297fe8d-8486-490f-9410-7f8aee9ee86f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Flavor limits 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 15:49:39.093562 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-2297fe8d-8486-490f-9410-7f8aee9ee86f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Image limits 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 15:49:39.094166 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-2297fe8d-8486-490f-9410-7f8aee9ee86f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Flavor pref 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 15:49:39.094637 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-2297fe8d-8486-490f-9410-7f8aee9ee86f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Image pref 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 15:49:39.095114 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-2297fe8d-8486-490f-9410-7f8aee9ee86f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 15:49:39.107030 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2297fe8d-8486-490f-9410-7f8aee9ee86f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:39.107565 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2297fe8d-8486-490f-9410-7f8aee9ee86f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:39.108475 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2297fe8d-8486-490f-9410-7f8aee9ee86f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:39.109086 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2297fe8d-8486-490f-9410-7f8aee9ee86f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:39.135616 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-2297fe8d-8486-490f-9410-7f8aee9ee86f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Getting quotas for project 44bf2643f52c4cc5aa01ae68ef13e12f. Resources: {'instances', 'ram', 'cores'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:49:39.140603 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-2297fe8d-8486-490f-9410-7f8aee9ee86f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Getting quotas for user 9b1c255006524ad9b700c0711ecbd569 and project 44bf2643f52c4cc5aa01ae68ef13e12f. Resources: {'instances', 'ram', 'cores'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:49:39.167177 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-2297fe8d-8486-490f-9410-7f8aee9ee86f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Going to run 1 instances... {{(pid=122399) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 15:49:39.170183 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-2297fe8d-8486-490f-9410-7f8aee9ee86f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 07a50ac4-a4f8-411a-9457-cd592eab7e7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a1434ad-0c2c-4725-baad-a605624baf01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 15:49:39.230668 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-2297fe8d-8486-490f-9410-7f8aee9ee86f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.705604 Dec 16 15:49:39.236180 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 74/147] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Dec 16 15:49:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 15:49:39.241624 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-ceb457fc-b726-4cc1-960f-8a90b9bdb442 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:39.242381 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-ceb457fc-b726-4cc1-960f-8a90b9bdb442 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 07a50ac4-a4f8-411a-9457-cd592eab7e7c] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:39.316631 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-ceb457fc-b726-4cc1-960f-8a90b9bdb442 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:39.323140 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-ceb457fc-b726-4cc1-960f-8a90b9bdb442 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c" status: 200 len: 1217 microversion: 2.1 time: 0.085610 Dec 16 15:49:39.323712 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 74/148] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:39 2021] GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:39.790120 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-33660d0b-7178-42c5-9d3e-23775c9929d3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:39.791886 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-33660d0b-7178-42c5-9d3e-23775c9929d3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:39.799151 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-aa2e7c2d-065c-47cd-8e2f-ab20da88c39f req-28bf62d4-af2f-494f-a4cc-ae864291f674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29bba044-2e01-44b1-bb03-0f367846a5f0", "tag": "1b9973de-48e3-4cb5-a15d-7bd646981f14"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:39.800750 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:49:39.800750 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:49:39.817922 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-33660d0b-7178-42c5-9d3e-23775c9929d3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:39.818444 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-33660d0b-7178-42c5-9d3e-23775c9929d3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:39.819154 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-33660d0b-7178-42c5-9d3e-23775c9929d3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:39.819606 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-33660d0b-7178-42c5-9d3e-23775c9929d3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:39.823478 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-aa2e7c2d-065c-47cd-8e2f-ab20da88c39f req-28bf62d4-af2f-494f-a4cc-ae864291f674 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:39.823932 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-aa2e7c2d-065c-47cd-8e2f-ab20da88c39f req-28bf62d4-af2f-494f-a4cc-ae864291f674 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:39.863250 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-aa2e7c2d-065c-47cd-8e2f-ab20da88c39f req-28bf62d4-af2f-494f-a4cc-ae864291f674 service nova] Creating event network-changed:1b9973de-48e3-4cb5-a15d-7bd646981f14 for instance 29bba044-2e01-44b1-bb03-0f367846a5f0 on hv-cinder-78447 Dec 16 15:49:39.875849 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-aa2e7c2d-065c-47cd-8e2f-ab20da88c39f req-28bf62d4-af2f-494f-a4cc-ae864291f674 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081098 Dec 16 15:49:39.879241 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 75/149] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:49:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:49:40.060925 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-33660d0b-7178-42c5-9d3e-23775c9929d3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 14 microversion: 2.1 time: 0.276388 Dec 16 15:49:40.064183 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 75/150] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:49:39 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 14 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 16 15:49:40.084127 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-c6828d30-6354-45b7-88a9-25ae9307e333 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:40.084888 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-c6828d30-6354-45b7-88a9-25ae9307e333 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:40.094962 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c6828d30-6354-45b7-88a9-25ae9307e333 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:40.098737 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c6828d30-6354-45b7-88a9-25ae9307e333 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:40.099944 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c6828d30-6354-45b7-88a9-25ae9307e333 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:40.109552 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c6828d30-6354-45b7-88a9-25ae9307e333 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:40.340421 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-dcc74709-d007-47a3-81b4-dc61b31a70c0 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:40.341120 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-dcc74709-d007-47a3-81b4-dc61b31a70c0 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 07a50ac4-a4f8-411a-9457-cd592eab7e7c] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:40.348813 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-dcc74709-d007-47a3-81b4-dc61b31a70c0 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:40.349754 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-dcc74709-d007-47a3-81b4-dc61b31a70c0 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:40.349857 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-dcc74709-d007-47a3-81b4-dc61b31a70c0 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:40.350213 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-dcc74709-d007-47a3-81b4-dc61b31a70c0 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:40.447688 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-dcc74709-d007-47a3-81b4-dc61b31a70c0 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:40.459828 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-dcc74709-d007-47a3-81b4-dc61b31a70c0 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c" status: 200 len: 1269 microversion: 2.1 time: 0.123491 Dec 16 15:49:40.461095 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 76/151] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:40 2021] GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c => generated 1269 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:49:40.498288 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-c6828d30-6354-45b7-88a9-25ae9307e333 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:40.514072 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-c6828d30-6354-45b7-88a9-25ae9307e333 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1521 microversion: 2.1 time: 0.435030 Dec 16 15:49:40.516998 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 76/152] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:40 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1521 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:41.075948 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-97973018-b9be-4aba-8b8a-1c801d7c42c2 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:41.077838 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-97973018-b9be-4aba-8b8a-1c801d7c42c2 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:41.088029 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-97973018-b9be-4aba-8b8a-1c801d7c42c2 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:41.088470 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-97973018-b9be-4aba-8b8a-1c801d7c42c2 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:41.089313 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-97973018-b9be-4aba-8b8a-1c801d7c42c2 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:41.089767 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-97973018-b9be-4aba-8b8a-1c801d7c42c2 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:41.168804 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-97973018-b9be-4aba-8b8a-1c801d7c42c2 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 14 microversion: 2.1 time: 0.096687 Dec 16 15:49:41.172426 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 77/153] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:49:41 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:49:41.479845 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-7fe53ec9-c6f2-4db9-af3c-adc61f9fe748 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:41.481649 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-7fe53ec9-c6f2-4db9-af3c-adc61f9fe748 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 07a50ac4-a4f8-411a-9457-cd592eab7e7c] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:41.507929 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7fe53ec9-c6f2-4db9-af3c-adc61f9fe748 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:41.512535 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7fe53ec9-c6f2-4db9-af3c-adc61f9fe748 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:41.514664 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7fe53ec9-c6f2-4db9-af3c-adc61f9fe748 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:41.515258 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7fe53ec9-c6f2-4db9-af3c-adc61f9fe748 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:41.534320 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ce23f402-f5b8-45d0-a9fc-1b13d00af173 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:41.535750 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-ce23f402-f5b8-45d0-a9fc-1b13d00af173 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:41.546738 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ce23f402-f5b8-45d0-a9fc-1b13d00af173 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:41.550814 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ce23f402-f5b8-45d0-a9fc-1b13d00af173 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:41.552021 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ce23f402-f5b8-45d0-a9fc-1b13d00af173 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:41.552589 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ce23f402-f5b8-45d0-a9fc-1b13d00af173 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:41.603578 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-7fe53ec9-c6f2-4db9-af3c-adc61f9fe748 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:41.617549 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-7fe53ec9-c6f2-4db9-af3c-adc61f9fe748 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c" status: 200 len: 1275 microversion: 2.1 time: 0.143818 Dec 16 15:49:41.618727 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 77/154] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:41 2021] GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c => generated 1275 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:41.730258 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-ce23f402-f5b8-45d0-a9fc-1b13d00af173 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:41.739192 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-ce23f402-f5b8-45d0-a9fc-1b13d00af173 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1521 microversion: 2.1 time: 0.208806 Dec 16 15:49:41.749603 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 78/155] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:41 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:42.180484 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-8f1c7871-fc75-499b-9926-7a905ba63fbc tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:42.181262 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-8f1c7871-fc75-499b-9926-7a905ba63fbc tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:42.188184 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8f1c7871-fc75-499b-9926-7a905ba63fbc tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:42.188812 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8f1c7871-fc75-499b-9926-7a905ba63fbc tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:42.189624 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8f1c7871-fc75-499b-9926-7a905ba63fbc tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:42.190053 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8f1c7871-fc75-499b-9926-7a905ba63fbc tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:42.635066 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-1662153a-57f9-4775-9c22-059e519056a7 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:42.635679 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-1662153a-57f9-4775-9c22-059e519056a7 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 07a50ac4-a4f8-411a-9457-cd592eab7e7c] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:42.641830 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1662153a-57f9-4775-9c22-059e519056a7 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:42.642359 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1662153a-57f9-4775-9c22-059e519056a7 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:42.643485 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1662153a-57f9-4775-9c22-059e519056a7 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:42.644217 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1662153a-57f9-4775-9c22-059e519056a7 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:42.785270 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-1662153a-57f9-4775-9c22-059e519056a7 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:42.793040 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-1662153a-57f9-4775-9c22-059e519056a7 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c" status: 200 len: 1317 microversion: 2.1 time: 0.162142 Dec 16 15:49:42.793869 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 79/156] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:42 2021] GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:42.798377 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-5531764f-c94c-4c29-be43-f8e935a43284 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:42.799170 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-5531764f-c94c-4c29-be43-f8e935a43284 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:42.804811 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5531764f-c94c-4c29-be43-f8e935a43284 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:42.805248 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5531764f-c94c-4c29-be43-f8e935a43284 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:42.806207 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5531764f-c94c-4c29-be43-f8e935a43284 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:42.806821 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5531764f-c94c-4c29-be43-f8e935a43284 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:42.947907 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-5531764f-c94c-4c29-be43-f8e935a43284 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:42.955540 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-5531764f-c94c-4c29-be43-f8e935a43284 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1521 microversion: 2.1 time: 0.160712 Dec 16 15:49:42.956383 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 80/157] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:42 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:43.812880 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-746feda3-87a6-49dd-ae58-62ad15d301c1 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:43.813622 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-746feda3-87a6-49dd-ae58-62ad15d301c1 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 07a50ac4-a4f8-411a-9457-cd592eab7e7c] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:43.820971 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-746feda3-87a6-49dd-ae58-62ad15d301c1 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:43.821644 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-746feda3-87a6-49dd-ae58-62ad15d301c1 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:43.822654 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-746feda3-87a6-49dd-ae58-62ad15d301c1 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:43.823410 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-746feda3-87a6-49dd-ae58-62ad15d301c1 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:43.970672 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-746feda3-87a6-49dd-ae58-62ad15d301c1 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:43.978942 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-746feda3-87a6-49dd-ae58-62ad15d301c1 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c" status: 200 len: 1317 microversion: 2.1 time: 0.171388 Dec 16 15:49:43.979444 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 81/158] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:43 2021] GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:49:43.991204 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-baca5a71-4d7d-4c6a-9d54-b30e7b3273c6 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:43.991839 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-baca5a71-4d7d-4c6a-9d54-b30e7b3273c6 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:43.997867 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-baca5a71-4d7d-4c6a-9d54-b30e7b3273c6 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:43.998310 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-baca5a71-4d7d-4c6a-9d54-b30e7b3273c6 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:43.999208 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-baca5a71-4d7d-4c6a-9d54-b30e7b3273c6 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:43.999627 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-baca5a71-4d7d-4c6a-9d54-b30e7b3273c6 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:44.141223 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-baca5a71-4d7d-4c6a-9d54-b30e7b3273c6 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:44.148690 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-baca5a71-4d7d-4c6a-9d54-b30e7b3273c6 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1521 microversion: 2.1 time: 0.167769 Dec 16 15:49:44.149231 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 82/159] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:43 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:44.990587 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-8f1c7871-fc75-499b-9926-7a905ba63fbc tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 14 microversion: 2.1 time: 2.813940 Dec 16 15:49:44.996478 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ee7951ec-1bec-4472-b4c5-a27c6d2bcddc tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:44.997754 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 78/160] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:49:42 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 14 bytes in 2822 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:49:44.998421 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-ee7951ec-1bec-4472-b4c5-a27c6d2bcddc tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 07a50ac4-a4f8-411a-9457-cd592eab7e7c] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:45.007604 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ee7951ec-1bec-4472-b4c5-a27c6d2bcddc tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:45.008076 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ee7951ec-1bec-4472-b4c5-a27c6d2bcddc tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:45.008875 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ee7951ec-1bec-4472-b4c5-a27c6d2bcddc tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:45.009294 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ee7951ec-1bec-4472-b4c5-a27c6d2bcddc tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:45.166312 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-93ffdfff-7a56-480f-bc14-9884553b3d13 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:45.167193 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-93ffdfff-7a56-480f-bc14-9884553b3d13 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:45.174486 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-93ffdfff-7a56-480f-bc14-9884553b3d13 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:45.175162 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-93ffdfff-7a56-480f-bc14-9884553b3d13 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:45.176297 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-93ffdfff-7a56-480f-bc14-9884553b3d13 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:45.176883 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-93ffdfff-7a56-480f-bc14-9884553b3d13 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:45.199812 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-ee7951ec-1bec-4472-b4c5-a27c6d2bcddc tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:45.207580 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-ee7951ec-1bec-4472-b4c5-a27c6d2bcddc tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c" status: 200 len: 1317 microversion: 2.1 time: 0.215073 Dec 16 15:49:45.208252 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 83/161] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:44 2021] GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:45.327598 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-93ffdfff-7a56-480f-bc14-9884553b3d13 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:45.335237 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-93ffdfff-7a56-480f-bc14-9884553b3d13 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1521 microversion: 2.1 time: 0.173230 Dec 16 15:49:45.335794 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 79/162] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:45 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:49:45.923398 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-30c7b9da-d828-4508-8643-488807bacdd4 req-75401c4d-75e2-4981-b2a6-ca244bd626e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07a50ac4-a4f8-411a-9457-cd592eab7e7c", "tag": "0711d501-f11e-421f-aa27-451f8a86c7e6"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:45.928318 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:49:45.928318 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:49:45.939806 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-30c7b9da-d828-4508-8643-488807bacdd4 req-75401c4d-75e2-4981-b2a6-ca244bd626e5 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:45.941124 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-30c7b9da-d828-4508-8643-488807bacdd4 req-75401c4d-75e2-4981-b2a6-ca244bd626e5 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:45.970042 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-30c7b9da-d828-4508-8643-488807bacdd4 req-75401c4d-75e2-4981-b2a6-ca244bd626e5 service nova] Creating event network-changed:0711d501-f11e-421f-aa27-451f8a86c7e6 for instance 07a50ac4-a4f8-411a-9457-cd592eab7e7c on hv-cinder-78447 Dec 16 15:49:45.976601 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-30c7b9da-d828-4508-8643-488807bacdd4 req-75401c4d-75e2-4981-b2a6-ca244bd626e5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060420 Dec 16 15:49:45.977525 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 84/163] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:49:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:49:46.007827 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-d1450aed-6f8f-4757-b10e-d300a9b1e072 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:46.008856 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-d1450aed-6f8f-4757-b10e-d300a9b1e072 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:46.019951 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d1450aed-6f8f-4757-b10e-d300a9b1e072 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:46.020826 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d1450aed-6f8f-4757-b10e-d300a9b1e072 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:46.021851 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d1450aed-6f8f-4757-b10e-d300a9b1e072 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:46.022673 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d1450aed-6f8f-4757-b10e-d300a9b1e072 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:46.136482 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-d1450aed-6f8f-4757-b10e-d300a9b1e072 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 14 microversion: 2.1 time: 0.132102 Dec 16 15:49:46.140012 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 80/164] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:49:46 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:49:46.230425 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-e60defd0-8426-4a48-a5ba-932f27181e5f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:46.234823 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-e60defd0-8426-4a48-a5ba-932f27181e5f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 07a50ac4-a4f8-411a-9457-cd592eab7e7c] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:46.247340 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e60defd0-8426-4a48-a5ba-932f27181e5f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:46.247778 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e60defd0-8426-4a48-a5ba-932f27181e5f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:46.248780 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e60defd0-8426-4a48-a5ba-932f27181e5f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:46.249207 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e60defd0-8426-4a48-a5ba-932f27181e5f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:46.359879 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-589bb432-1c0b-4f9a-b93c-aa432e61e68c tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:46.360907 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-589bb432-1c0b-4f9a-b93c-aa432e61e68c tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:46.377611 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-589bb432-1c0b-4f9a-b93c-aa432e61e68c tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:46.381247 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-589bb432-1c0b-4f9a-b93c-aa432e61e68c tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:46.382598 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-589bb432-1c0b-4f9a-b93c-aa432e61e68c tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:46.383290 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-589bb432-1c0b-4f9a-b93c-aa432e61e68c tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:46.418334 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-e60defd0-8426-4a48-a5ba-932f27181e5f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:46.431168 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-e60defd0-8426-4a48-a5ba-932f27181e5f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c" status: 200 len: 1317 microversion: 2.1 time: 0.210508 Dec 16 15:49:46.431753 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 85/165] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:46 2021] GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:46.675091 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-2bd98a29-c13c-4748-95b1-d816ba64a624 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:46.676195 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-2bd98a29-c13c-4748-95b1-d816ba64a624 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:46.690269 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2bd98a29-c13c-4748-95b1-d816ba64a624 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:46.692235 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2bd98a29-c13c-4748-95b1-d816ba64a624 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:46.693307 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2bd98a29-c13c-4748-95b1-d816ba64a624 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:46.694324 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2bd98a29-c13c-4748-95b1-d816ba64a624 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:46.735901 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-2bd98a29-c13c-4748-95b1-d816ba64a624 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Going to try to terminate instance {{(pid=122399) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 15:49:46.856035 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-2bd98a29-c13c-4748-95b1-d816ba64a624 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "DELETE /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 204 len: 0 microversion: 2.1 time: 0.185685 Dec 16 15:49:46.857471 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 86/166] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Dec 16 15:49:46 2021] DELETE /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:49:46.863598 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-589bb432-1c0b-4f9a-b93c-aa432e61e68c tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:46.869831 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-10bf51e0-76ec-417c-91a6-3ddb79952755 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:46.870646 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-10bf51e0-76ec-417c-91a6-3ddb79952755 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:46.872135 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-589bb432-1c0b-4f9a-b93c-aa432e61e68c tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1521 microversion: 2.1 time: 0.523426 Dec 16 15:49:46.872717 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 81/167] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:46 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1521 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:46.878310 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-10bf51e0-76ec-417c-91a6-3ddb79952755 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:46.878899 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-10bf51e0-76ec-417c-91a6-3ddb79952755 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:46.880057 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-10bf51e0-76ec-417c-91a6-3ddb79952755 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:46.880562 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-10bf51e0-76ec-417c-91a6-3ddb79952755 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:47.040720 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-10bf51e0-76ec-417c-91a6-3ddb79952755 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13254b92b9e94bda88f0881524ae26bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5edb8b1d36e4f01bc38f277910faf05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:47.050563 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-10bf51e0-76ec-417c-91a6-3ddb79952755 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 200 len: 1553 microversion: 2.1 time: 0.188923 Dec 16 15:49:47.052215 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 87/168] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:46 2021] GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 1553 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:49:47.148264 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-62baf040-4061-4816-9e1f-662e9b1e4cc0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:47.149648 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-62baf040-4061-4816-9e1f-662e9b1e4cc0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:47.157861 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-62baf040-4061-4816-9e1f-662e9b1e4cc0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:47.158311 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-62baf040-4061-4816-9e1f-662e9b1e4cc0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:47.165533 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-62baf040-4061-4816-9e1f-662e9b1e4cc0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:47.166764 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-62baf040-4061-4816-9e1f-662e9b1e4cc0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:47.303209 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-62baf040-4061-4816-9e1f-662e9b1e4cc0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 14 microversion: 2.1 time: 0.159099 Dec 16 15:49:47.304165 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 82/169] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:49:47 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 14 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:49:47.447941 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-af75542d-8755-4d3c-a289-f32b1d642716 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:47.448715 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-af75542d-8755-4d3c-a289-f32b1d642716 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 07a50ac4-a4f8-411a-9457-cd592eab7e7c] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:47.455716 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-af75542d-8755-4d3c-a289-f32b1d642716 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:47.456263 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-af75542d-8755-4d3c-a289-f32b1d642716 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:47.457147 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-af75542d-8755-4d3c-a289-f32b1d642716 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:47.457630 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-af75542d-8755-4d3c-a289-f32b1d642716 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:47.599173 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-af75542d-8755-4d3c-a289-f32b1d642716 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:47.612268 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-af75542d-8755-4d3c-a289-f32b1d642716 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c" status: 200 len: 1317 microversion: 2.1 time: 0.168098 Dec 16 15:49:47.612959 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 88/170] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:47 2021] GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:47.891157 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-faa1e905-c909-4b77-96d1-cb010d2e7b05 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:47.892095 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-faa1e905-c909-4b77-96d1-cb010d2e7b05 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:47.900751 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-faa1e905-c909-4b77-96d1-cb010d2e7b05 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:47.901580 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-faa1e905-c909-4b77-96d1-cb010d2e7b05 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:47.902370 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-faa1e905-c909-4b77-96d1-cb010d2e7b05 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:47.903173 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-faa1e905-c909-4b77-96d1-cb010d2e7b05 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:48.045940 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-faa1e905-c909-4b77-96d1-cb010d2e7b05 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:48.053233 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-faa1e905-c909-4b77-96d1-cb010d2e7b05 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1521 microversion: 2.1 time: 0.166201 Dec 16 15:49:48.053848 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 83/171] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:47 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:48.069081 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-940a7be4-e588-4380-9af8-e65009a39037 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:48.069807 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-940a7be4-e588-4380-9af8-e65009a39037 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:48.076863 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-940a7be4-e588-4380-9af8-e65009a39037 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:48.077307 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-940a7be4-e588-4380-9af8-e65009a39037 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:48.078172 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-940a7be4-e588-4380-9af8-e65009a39037 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:48.078595 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-940a7be4-e588-4380-9af8-e65009a39037 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:48.212884 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-940a7be4-e588-4380-9af8-e65009a39037 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13254b92b9e94bda88f0881524ae26bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5edb8b1d36e4f01bc38f277910faf05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:48.221765 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-940a7be4-e588-4380-9af8-e65009a39037 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 200 len: 1553 microversion: 2.1 time: 0.157403 Dec 16 15:49:48.222406 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 89/172] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:48 2021] GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:48.320763 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-664900b0-560a-429f-84d2-c829b3df9e69 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:48.321624 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-664900b0-560a-429f-84d2-c829b3df9e69 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:48.328367 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-664900b0-560a-429f-84d2-c829b3df9e69 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:48.329076 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-664900b0-560a-429f-84d2-c829b3df9e69 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:48.330897 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-664900b0-560a-429f-84d2-c829b3df9e69 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:48.331515 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-664900b0-560a-429f-84d2-c829b3df9e69 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:48.413304 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-664900b0-560a-429f-84d2-c829b3df9e69 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 14 microversion: 2.1 time: 0.096331 Dec 16 15:49:48.414125 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 84/173] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:49:48 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:49:48.628829 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-8e9fbb7c-13c0-416c-9747-5642ff09625d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:48.629445 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-8e9fbb7c-13c0-416c-9747-5642ff09625d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 07a50ac4-a4f8-411a-9457-cd592eab7e7c] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:48.636021 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8e9fbb7c-13c0-416c-9747-5642ff09625d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:48.636461 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8e9fbb7c-13c0-416c-9747-5642ff09625d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:48.637241 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8e9fbb7c-13c0-416c-9747-5642ff09625d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:48.637713 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8e9fbb7c-13c0-416c-9747-5642ff09625d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:48.782066 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-8e9fbb7c-13c0-416c-9747-5642ff09625d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:48.790072 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-8e9fbb7c-13c0-416c-9747-5642ff09625d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c" status: 200 len: 1317 microversion: 2.1 time: 0.164603 Dec 16 15:49:48.790630 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 90/174] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:48 2021] GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:49.072849 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-addf081a-75a6-4656-a974-ea4fd80d28bd tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:49.073316 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-addf081a-75a6-4656-a974-ea4fd80d28bd tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:49.082327 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-addf081a-75a6-4656-a974-ea4fd80d28bd tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:49.082928 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-addf081a-75a6-4656-a974-ea4fd80d28bd tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:49.084151 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-addf081a-75a6-4656-a974-ea4fd80d28bd tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:49.085140 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-addf081a-75a6-4656-a974-ea4fd80d28bd tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:49.223612 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-addf081a-75a6-4656-a974-ea4fd80d28bd tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:49.231628 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-addf081a-75a6-4656-a974-ea4fd80d28bd tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1521 microversion: 2.1 time: 0.164696 Dec 16 15:49:49.232507 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 85/175] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:49 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:49.238550 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-79c71d6e-25a0-4e87-ac03-607adc5f92cc tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:49.239164 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-79c71d6e-25a0-4e87-ac03-607adc5f92cc tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:49.244937 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-79c71d6e-25a0-4e87-ac03-607adc5f92cc tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:49.245381 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-79c71d6e-25a0-4e87-ac03-607adc5f92cc tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:49.246190 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-79c71d6e-25a0-4e87-ac03-607adc5f92cc tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:49.246621 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-79c71d6e-25a0-4e87-ac03-607adc5f92cc tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:49.373339 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-79c71d6e-25a0-4e87-ac03-607adc5f92cc tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13254b92b9e94bda88f0881524ae26bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5edb8b1d36e4f01bc38f277910faf05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:49.381135 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-79c71d6e-25a0-4e87-ac03-607adc5f92cc tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 200 len: 1553 microversion: 2.1 time: 0.146185 Dec 16 15:49:49.382000 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 91/176] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:49 2021] GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:49.427704 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-d2d62d4f-98ea-4d36-b967-a44f033f2334 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:49.429383 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-d2d62d4f-98ea-4d36-b967-a44f033f2334 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:49.436271 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d2d62d4f-98ea-4d36-b967-a44f033f2334 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:49.436747 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d2d62d4f-98ea-4d36-b967-a44f033f2334 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:49.437801 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d2d62d4f-98ea-4d36-b967-a44f033f2334 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:49.438233 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d2d62d4f-98ea-4d36-b967-a44f033f2334 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:49.532693 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-d2d62d4f-98ea-4d36-b967-a44f033f2334 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 14 microversion: 2.1 time: 0.111687 Dec 16 15:49:49.533176 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 86/177] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:49:49 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:49:49.806391 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-aca1e7dc-0429-42c8-9682-a0d5a1d79c89 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:49.806966 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-aca1e7dc-0429-42c8-9682-a0d5a1d79c89 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 07a50ac4-a4f8-411a-9457-cd592eab7e7c] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:49.819345 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-aca1e7dc-0429-42c8-9682-a0d5a1d79c89 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:49.819993 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-aca1e7dc-0429-42c8-9682-a0d5a1d79c89 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:49.820952 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-aca1e7dc-0429-42c8-9682-a0d5a1d79c89 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:49.821564 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-aca1e7dc-0429-42c8-9682-a0d5a1d79c89 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:50.084802 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-aca1e7dc-0429-42c8-9682-a0d5a1d79c89 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:50.093662 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-aca1e7dc-0429-42c8-9682-a0d5a1d79c89 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c" status: 200 len: 1317 microversion: 2.1 time: 0.290640 Dec 16 15:49:50.094327 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 92/178] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:49 2021] GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c => generated 1317 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:50.250618 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-ac608a2f-46de-4504-b638-58e2b8b898d9 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:50.251432 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-ac608a2f-46de-4504-b638-58e2b8b898d9 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:50.258868 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ac608a2f-46de-4504-b638-58e2b8b898d9 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:50.259415 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ac608a2f-46de-4504-b638-58e2b8b898d9 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:50.260340 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ac608a2f-46de-4504-b638-58e2b8b898d9 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:50.260844 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ac608a2f-46de-4504-b638-58e2b8b898d9 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:50.399439 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-0f1183c7-fbbe-42d9-8a43-d6531a37c210 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:50.400415 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-ac608a2f-46de-4504-b638-58e2b8b898d9 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:50.400558 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-0f1183c7-fbbe-42d9-8a43-d6531a37c210 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:50.407754 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0f1183c7-fbbe-42d9-8a43-d6531a37c210 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:50.408396 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0f1183c7-fbbe-42d9-8a43-d6531a37c210 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:50.408556 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-ac608a2f-46de-4504-b638-58e2b8b898d9 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1521 microversion: 2.1 time: 0.163420 Dec 16 15:49:50.409848 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0f1183c7-fbbe-42d9-8a43-d6531a37c210 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:50.410396 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0f1183c7-fbbe-42d9-8a43-d6531a37c210 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:50.418023 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 87/179] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:50 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:50.544130 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-2e7d275d-7238-4e25-9ba9-a6f8fb7ec6ed tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:50.546044 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-2e7d275d-7238-4e25-9ba9-a6f8fb7ec6ed tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:50.555987 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2e7d275d-7238-4e25-9ba9-a6f8fb7ec6ed tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:50.556421 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2e7d275d-7238-4e25-9ba9-a6f8fb7ec6ed tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:50.558163 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2e7d275d-7238-4e25-9ba9-a6f8fb7ec6ed tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:50.561325 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2e7d275d-7238-4e25-9ba9-a6f8fb7ec6ed tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:50.625872 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-0f1183c7-fbbe-42d9-8a43-d6531a37c210 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13254b92b9e94bda88f0881524ae26bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5edb8b1d36e4f01bc38f277910faf05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:50.652094 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-0f1183c7-fbbe-42d9-8a43-d6531a37c210 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 200 len: 1553 microversion: 2.1 time: 0.253479 Dec 16 15:49:50.663919 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 93/180] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:50 2021] GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 1553 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:50.683609 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-2e7d275d-7238-4e25-9ba9-a6f8fb7ec6ed tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 14 microversion: 2.1 time: 0.143897 Dec 16 15:49:50.684590 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 88/181] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:49:50 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 16 15:49:51.113289 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-eb01fd7b-f95f-428f-a292-bc17f688f967 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:51.114370 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-eb01fd7b-f95f-428f-a292-bc17f688f967 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 07a50ac4-a4f8-411a-9457-cd592eab7e7c] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:51.122783 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-eb01fd7b-f95f-428f-a292-bc17f688f967 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:51.123510 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-eb01fd7b-f95f-428f-a292-bc17f688f967 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:51.124309 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-eb01fd7b-f95f-428f-a292-bc17f688f967 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:51.124739 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-eb01fd7b-f95f-428f-a292-bc17f688f967 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:51.240855 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-76faa610-9e39-4ec4-9ece-43b72b82f37d req-63fca22c-e0fb-4ce6-b140-492d32cafd66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b15a27c-e6e3-4ac9-8882-9e52028c3bbd", "name": "network-vif-deleted", "tag": "f5b55a14-2204-4e1f-a1f9-794314afd998"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:51.242972 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:49:51.242972 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:49:51.252071 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-76faa610-9e39-4ec4-9ece-43b72b82f37d req-63fca22c-e0fb-4ce6-b140-492d32cafd66 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:51.252556 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-76faa610-9e39-4ec4-9ece-43b72b82f37d req-63fca22c-e0fb-4ce6-b140-492d32cafd66 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:51.267758 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-76faa610-9e39-4ec4-9ece-43b72b82f37d req-63fca22c-e0fb-4ce6-b140-492d32cafd66 service nova] Creating event network-vif-deleted:f5b55a14-2204-4e1f-a1f9-794314afd998 for instance 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd on hv-cinder-78447 Dec 16 15:49:51.274453 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-76faa610-9e39-4ec4-9ece-43b72b82f37d req-63fca22c-e0fb-4ce6-b140-492d32cafd66 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037150 Dec 16 15:49:51.275693 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 89/182] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:49:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:49:51.297920 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-eb01fd7b-f95f-428f-a292-bc17f688f967 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:51.306240 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-eb01fd7b-f95f-428f-a292-bc17f688f967 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c" status: 200 len: 1317 microversion: 2.1 time: 0.198256 Dec 16 15:49:51.307151 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 94/183] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:51 2021] GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:51.426257 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-7e5abf7c-0644-4d69-b9dd-67cf5d436874 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:51.427135 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-7e5abf7c-0644-4d69-b9dd-67cf5d436874 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:51.433199 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7e5abf7c-0644-4d69-b9dd-67cf5d436874 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:51.433673 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7e5abf7c-0644-4d69-b9dd-67cf5d436874 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:51.434882 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7e5abf7c-0644-4d69-b9dd-67cf5d436874 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:51.435462 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7e5abf7c-0644-4d69-b9dd-67cf5d436874 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:51.600729 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-7e5abf7c-0644-4d69-b9dd-67cf5d436874 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:51.610851 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-7e5abf7c-0644-4d69-b9dd-67cf5d436874 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1521 microversion: 2.1 time: 0.189083 Dec 16 15:49:51.611865 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 90/184] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:51 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:51.670536 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-6a13282f-cb47-4b38-acb4-d8c63fbfd4cd tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:51.671688 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-6a13282f-cb47-4b38-acb4-d8c63fbfd4cd tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:51.678764 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6a13282f-cb47-4b38-acb4-d8c63fbfd4cd tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:51.679206 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6a13282f-cb47-4b38-acb4-d8c63fbfd4cd tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:51.680037 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6a13282f-cb47-4b38-acb4-d8c63fbfd4cd tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:51.680368 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6a13282f-cb47-4b38-acb4-d8c63fbfd4cd tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:51.695252 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-8d5182ac-0ead-48b7-8181-89b6faf97150 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:51.696144 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-8d5182ac-0ead-48b7-8181-89b6faf97150 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:51.721885 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8d5182ac-0ead-48b7-8181-89b6faf97150 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:51.722794 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8d5182ac-0ead-48b7-8181-89b6faf97150 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:51.723850 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8d5182ac-0ead-48b7-8181-89b6faf97150 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:51.725044 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8d5182ac-0ead-48b7-8181-89b6faf97150 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:51.783289 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-6a13282f-cb47-4b38-acb4-d8c63fbfd4cd tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13254b92b9e94bda88f0881524ae26bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5edb8b1d36e4f01bc38f277910faf05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:51.791603 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-6a13282f-cb47-4b38-acb4-d8c63fbfd4cd tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 200 len: 1345 microversion: 2.1 time: 0.125745 Dec 16 15:49:51.792231 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 95/185] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:51 2021] GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 1345 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:51.814371 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-8d5182ac-0ead-48b7-8181-89b6faf97150 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 14 microversion: 2.1 time: 0.123057 Dec 16 15:49:51.815115 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 91/186] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:49:51 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:49:52.013984 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-8f89e401-68b7-403b-841f-f4fcb38b16f7 req-ca42978a-65b6-46e2-a2c4-e3dad56be715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07a50ac4-a4f8-411a-9457-cd592eab7e7c", "name": "network-vif-plugged", "status": "completed", "tag": "0711d501-f11e-421f-aa27-451f8a86c7e6"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:52.017466 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:49:52.017466 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:49:52.036028 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-8f89e401-68b7-403b-841f-f4fcb38b16f7 req-ca42978a-65b6-46e2-a2c4-e3dad56be715 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:52.036519 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-8f89e401-68b7-403b-841f-f4fcb38b16f7 req-ca42978a-65b6-46e2-a2c4-e3dad56be715 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:52.050694 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-8f89e401-68b7-403b-841f-f4fcb38b16f7 req-ca42978a-65b6-46e2-a2c4-e3dad56be715 service nova] Creating event network-vif-plugged:0711d501-f11e-421f-aa27-451f8a86c7e6 for instance 07a50ac4-a4f8-411a-9457-cd592eab7e7c on hv-cinder-78447 Dec 16 15:49:52.057670 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-8f89e401-68b7-403b-841f-f4fcb38b16f7 req-ca42978a-65b6-46e2-a2c4-e3dad56be715 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053571 Dec 16 15:49:52.059948 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 96/187] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:49:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:49:52.345172 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-27b47a8a-00a1-4c09-a204-96e3d051c03e tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:52.346629 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-27b47a8a-00a1-4c09-a204-96e3d051c03e tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 07a50ac4-a4f8-411a-9457-cd592eab7e7c] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:52.363837 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-27b47a8a-00a1-4c09-a204-96e3d051c03e tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:52.364520 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-27b47a8a-00a1-4c09-a204-96e3d051c03e tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:52.365689 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-27b47a8a-00a1-4c09-a204-96e3d051c03e tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:52.366345 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-27b47a8a-00a1-4c09-a204-96e3d051c03e tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:52.526154 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-27b47a8a-00a1-4c09-a204-96e3d051c03e tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:52.533874 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-27b47a8a-00a1-4c09-a204-96e3d051c03e tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c" status: 200 len: 1317 microversion: 2.1 time: 0.201041 Dec 16 15:49:52.534441 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 92/188] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:52 2021] GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c => generated 1317 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:52.629019 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-b67be02c-722e-450c-90d0-864eb33da61d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:52.629736 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-b67be02c-722e-450c-90d0-864eb33da61d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:52.635655 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b67be02c-722e-450c-90d0-864eb33da61d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:52.636099 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b67be02c-722e-450c-90d0-864eb33da61d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:52.636865 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b67be02c-722e-450c-90d0-864eb33da61d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:52.637307 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b67be02c-722e-450c-90d0-864eb33da61d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:52.775317 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-b67be02c-722e-450c-90d0-864eb33da61d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:52.782720 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-b67be02c-722e-450c-90d0-864eb33da61d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1521 microversion: 2.1 time: 0.158274 Dec 16 15:49:52.783285 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 97/189] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:52 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:52.825258 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-49cb37a6-20b5-4ed4-bfa4-c010541c5132 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:52.826336 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-49cb37a6-20b5-4ed4-bfa4-c010541c5132 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:52.833103 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-49cb37a6-20b5-4ed4-bfa4-c010541c5132 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:52.833585 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-49cb37a6-20b5-4ed4-bfa4-c010541c5132 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:52.834380 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-49cb37a6-20b5-4ed4-bfa4-c010541c5132 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:52.834813 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-49cb37a6-20b5-4ed4-bfa4-c010541c5132 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:52.850682 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-160c32dc-55d2-4cea-8653-ccd201fd31a1 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:52.851361 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-160c32dc-55d2-4cea-8653-ccd201fd31a1 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:52.858335 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-160c32dc-55d2-4cea-8653-ccd201fd31a1 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:52.858787 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-160c32dc-55d2-4cea-8653-ccd201fd31a1 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:52.859569 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-160c32dc-55d2-4cea-8653-ccd201fd31a1 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:52.860002 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-160c32dc-55d2-4cea-8653-ccd201fd31a1 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:52.874247 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.wsgi [None req-160c32dc-55d2-4cea-8653-ccd201fd31a1 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] HTTP exception thrown: Instance 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd could not be found. Dec 16 15:49:52.874890 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-160c32dc-55d2-4cea-8653-ccd201fd31a1 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Returning 404 to user: Instance 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd could not be found. {{(pid=122399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:49:52.875738 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-160c32dc-55d2-4cea-8653-ccd201fd31a1 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 404 len: 111 microversion: 2.1 time: 0.028791 Dec 16 15:49:52.876317 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 98/190] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:52 2021] GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 16 15:49:52.905722 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-49cb37a6-20b5-4ed4-bfa4-c010541c5132 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 14 microversion: 2.1 time: 0.083848 Dec 16 15:49:52.908797 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 93/191] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:49:52 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:49:52.980366 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-88f57b4e-31e4-4300-8d7c-085f75ef918b tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:52.981392 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-88f57b4e-31e4-4300-8d7c-085f75ef918b tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:52.987359 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-88f57b4e-31e4-4300-8d7c-085f75ef918b tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:52.987863 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-88f57b4e-31e4-4300-8d7c-085f75ef918b tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:52.988635 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-88f57b4e-31e4-4300-8d7c-085f75ef918b tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:52.989066 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-88f57b4e-31e4-4300-8d7c-085f75ef918b tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:53.002519 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.wsgi [None req-88f57b4e-31e4-4300-8d7c-085f75ef918b tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] HTTP exception thrown: Instance 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd could not be found. Dec 16 15:49:53.003112 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-88f57b4e-31e4-4300-8d7c-085f75ef918b tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Returning 404 to user: Instance 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd could not be found. {{(pid=122399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:49:53.003958 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-88f57b4e-31e4-4300-8d7c-085f75ef918b tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.027754 Dec 16 15:49:53.004597 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 99/192] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Dec 16 15:49:52 2021] GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd/os-volume_attachments => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:49:53.553204 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-1f6c25d0-0470-4d29-ab65-eb2cb2eda59c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:53.553204 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-1f6c25d0-0470-4d29-ab65-eb2cb2eda59c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 07a50ac4-a4f8-411a-9457-cd592eab7e7c] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:53.560645 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1f6c25d0-0470-4d29-ab65-eb2cb2eda59c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:53.561327 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1f6c25d0-0470-4d29-ab65-eb2cb2eda59c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:53.562460 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1f6c25d0-0470-4d29-ab65-eb2cb2eda59c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:53.563094 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1f6c25d0-0470-4d29-ab65-eb2cb2eda59c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:53.723091 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-1f6c25d0-0470-4d29-ab65-eb2cb2eda59c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:53.730852 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-1f6c25d0-0470-4d29-ab65-eb2cb2eda59c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c" status: 200 len: 1317 microversion: 2.1 time: 0.182998 Dec 16 15:49:53.731624 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 94/193] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:53 2021] GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:53.801290 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-157ba07e-2878-49b8-9cff-4ef548f93295 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:53.802174 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-157ba07e-2878-49b8-9cff-4ef548f93295 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:53.808552 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-157ba07e-2878-49b8-9cff-4ef548f93295 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:53.809190 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-157ba07e-2878-49b8-9cff-4ef548f93295 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:53.810167 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-157ba07e-2878-49b8-9cff-4ef548f93295 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:53.810748 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-157ba07e-2878-49b8-9cff-4ef548f93295 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:53.917554 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-d963c0c3-f215-42ed-ae58-b232aa9bcead tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:53.918911 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-d963c0c3-f215-42ed-ae58-b232aa9bcead tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:53.925487 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d963c0c3-f215-42ed-ae58-b232aa9bcead tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:53.926336 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d963c0c3-f215-42ed-ae58-b232aa9bcead tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:53.927284 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d963c0c3-f215-42ed-ae58-b232aa9bcead tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:53.927710 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d963c0c3-f215-42ed-ae58-b232aa9bcead tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:53.972069 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-157ba07e-2878-49b8-9cff-4ef548f93295 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:53.978824 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-157ba07e-2878-49b8-9cff-4ef548f93295 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1521 microversion: 2.1 time: 0.182385 Dec 16 15:49:53.979587 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 100/194] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:53 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:53.997644 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-d963c0c3-f215-42ed-ae58-b232aa9bcead tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 14 microversion: 2.1 time: 0.083254 Dec 16 15:49:53.998299 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 95/195] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:49:53 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:49:54.241954 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-b9f4904d-2e86-4b1e-90eb-382bd43fc283 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:54.242449 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-b9f4904d-2e86-4b1e-90eb-382bd43fc283 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:54.248303 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b9f4904d-2e86-4b1e-90eb-382bd43fc283 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:54.248748 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b9f4904d-2e86-4b1e-90eb-382bd43fc283 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:54.249747 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b9f4904d-2e86-4b1e-90eb-382bd43fc283 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:54.250182 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b9f4904d-2e86-4b1e-90eb-382bd43fc283 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:54.263062 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.wsgi [None req-b9f4904d-2e86-4b1e-90eb-382bd43fc283 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] HTTP exception thrown: Instance 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd could not be found. Dec 16 15:49:54.263678 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-b9f4904d-2e86-4b1e-90eb-382bd43fc283 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Returning 404 to user: Instance 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd could not be found. {{(pid=122399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:49:54.264504 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-b9f4904d-2e86-4b1e-90eb-382bd43fc283 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "DELETE /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 404 len: 111 microversion: 2.1 time: 0.026216 Dec 16 15:49:54.265242 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 101/196] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Dec 16 15:49:54 2021] DELETE /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:49:54.273641 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-72d5a195-2ba1-489e-8077-67fe2f760e01 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:54.274560 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-72d5a195-2ba1-489e-8077-67fe2f760e01 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] [instance: 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:54.281368 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-72d5a195-2ba1-489e-8077-67fe2f760e01 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:54.281911 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-72d5a195-2ba1-489e-8077-67fe2f760e01 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:54.282742 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-72d5a195-2ba1-489e-8077-67fe2f760e01 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:54.283232 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-72d5a195-2ba1-489e-8077-67fe2f760e01 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:54.302934 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.wsgi [None req-72d5a195-2ba1-489e-8077-67fe2f760e01 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] HTTP exception thrown: Instance 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd could not be found. Dec 16 15:49:54.303524 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-72d5a195-2ba1-489e-8077-67fe2f760e01 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] Returning 404 to user: Instance 8b15a27c-e6e3-4ac9-8882-9e52028c3bbd could not be found. {{(pid=122398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:49:54.304334 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-72d5a195-2ba1-489e-8077-67fe2f760e01 tempest-DeleteServersTestJSON-1000085460 tempest-DeleteServersTestJSON-1000085460-project] 10.222.0.31 "GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd" status: 404 len: 111 microversion: 2.1 time: 0.034821 Dec 16 15:49:54.304894 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 96/197] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:54 2021] GET /compute/v2.1/servers/8b15a27c-e6e3-4ac9-8882-9e52028c3bbd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:49:54.747970 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-7d340ac1-421e-4f8f-9d5e-b98452202637 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:54.748833 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-7d340ac1-421e-4f8f-9d5e-b98452202637 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 07a50ac4-a4f8-411a-9457-cd592eab7e7c] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:54.759523 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7d340ac1-421e-4f8f-9d5e-b98452202637 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:54.760206 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7d340ac1-421e-4f8f-9d5e-b98452202637 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:54.761192 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7d340ac1-421e-4f8f-9d5e-b98452202637 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:54.762540 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7d340ac1-421e-4f8f-9d5e-b98452202637 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:55.001455 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-b3d72413-555d-4e9d-8127-74cf21eca96a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:55.002918 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-b3d72413-555d-4e9d-8127-74cf21eca96a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:55.015509 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b3d72413-555d-4e9d-8127-74cf21eca96a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:55.016096 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b3d72413-555d-4e9d-8127-74cf21eca96a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:55.016916 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b3d72413-555d-4e9d-8127-74cf21eca96a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:55.020610 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b3d72413-555d-4e9d-8127-74cf21eca96a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:55.026019 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-7d340ac1-421e-4f8f-9d5e-b98452202637 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:55.035926 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-7d340ac1-421e-4f8f-9d5e-b98452202637 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c" status: 200 len: 1507 microversion: 2.1 time: 0.291962 Dec 16 15:49:55.038697 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 102/198] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:54 2021] GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c => generated 1507 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:55.044488 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-43205c04-559c-4a96-8a9d-1aa55ae5d2ef tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:55.045652 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-43205c04-559c-4a96-8a9d-1aa55ae5d2ef tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:55.070011 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-43205c04-559c-4a96-8a9d-1aa55ae5d2ef tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:55.070672 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-43205c04-559c-4a96-8a9d-1aa55ae5d2ef tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:55.072968 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-43205c04-559c-4a96-8a9d-1aa55ae5d2ef tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:55.073578 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-43205c04-559c-4a96-8a9d-1aa55ae5d2ef tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:55.169678 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-43205c04-559c-4a96-8a9d-1aa55ae5d2ef tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 14 microversion: 2.1 time: 0.129272 Dec 16 15:49:55.170363 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 103/199] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:49:55 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:49:55.178937 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-52d4ac4a-7d6d-4071-a825-0f6e0caaa82c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9bc8494e-ab80-4f87-9437-b6a9f5e605d4"}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:55.179944 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-52d4ac4a-7d6d-4071-a825-0f6e0caaa82c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 07a50ac4-a4f8-411a-9457-cd592eab7e7c] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:55.197283 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-52d4ac4a-7d6d-4071-a825-0f6e0caaa82c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:55.198759 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-52d4ac4a-7d6d-4071-a825-0f6e0caaa82c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:55.199675 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-52d4ac4a-7d6d-4071-a825-0f6e0caaa82c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:55.202648 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-52d4ac4a-7d6d-4071-a825-0f6e0caaa82c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:55.257755 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-b3d72413-555d-4e9d-8127-74cf21eca96a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:55.264493 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-b3d72413-555d-4e9d-8127-74cf21eca96a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1521 microversion: 2.1 time: 0.270401 Dec 16 15:49:55.264877 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 97/200] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:54 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:55.336681 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.wsgi [None req-52d4ac4a-7d6d-4071-a825-0f6e0caaa82c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] HTTP exception thrown: Invalid volume: volume 9bc8494e-ab80-4f87-9437-b6a9f5e605d4 is already attached to instances: 833cc951-4fe1-4d89-884f-6c98308de4bc Dec 16 15:49:55.337191 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-52d4ac4a-7d6d-4071-a825-0f6e0caaa82c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Returning 400 to user: Invalid volume: volume 9bc8494e-ab80-4f87-9437-b6a9f5e605d4 is already attached to instances: 833cc951-4fe1-4d89-884f-6c98308de4bc {{(pid=122399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:49:55.338065 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-52d4ac4a-7d6d-4071-a825-0f6e0caaa82c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "POST /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.163791 Dec 16 15:49:55.341117 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 104/201] 10.222.0.31 () {60 vars in 1322 bytes} [Thu Dec 16 15:49:55 2021] POST /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c/os-volume_attachments => generated 174 bytes in 170 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 16 15:49:55.475938 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-b5badd2a-e8b2-41b2-b383-c4f473aaaa0b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:55.476894 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-b5badd2a-e8b2-41b2-b383-c4f473aaaa0b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:55.491600 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b5badd2a-e8b2-41b2-b383-c4f473aaaa0b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:55.492564 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b5badd2a-e8b2-41b2-b383-c4f473aaaa0b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:55.493211 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b5badd2a-e8b2-41b2-b383-c4f473aaaa0b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:55.493750 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b5badd2a-e8b2-41b2-b383-c4f473aaaa0b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:55.656359 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.objects.instance [None req-b5badd2a-e8b2-41b2-b383-c4f473aaaa0b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lazy-loading 'services' on Instance uuid 833cc951-4fe1-4d89-884f-6c98308de4bc {{(pid=122398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:49:55.811500 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-b5badd2a-e8b2-41b2-b383-c4f473aaaa0b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "DELETE /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc/os-volume_attachments/9bc8494e-ab80-4f87-9437-b6a9f5e605d4" status: 202 len: 0 microversion: 2.1 time: 0.339169 Dec 16 15:49:55.812507 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 98/202] 10.222.0.31 () {58 vars in 1415 bytes} [Thu Dec 16 15:49:55 2021] DELETE /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc/os-volume_attachments/9bc8494e-ab80-4f87-9437-b6a9f5e605d4 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:49:55.822254 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-a1d0a08f-a393-4024-9244-1f163c7dd50f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:55.823291 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-a1d0a08f-a393-4024-9244-1f163c7dd50f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:55.839353 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a1d0a08f-a393-4024-9244-1f163c7dd50f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:55.840304 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a1d0a08f-a393-4024-9244-1f163c7dd50f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:55.841562 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a1d0a08f-a393-4024-9244-1f163c7dd50f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:55.842118 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a1d0a08f-a393-4024-9244-1f163c7dd50f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:55.877860 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-a1d0a08f-a393-4024-9244-1f163c7dd50f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061005 Dec 16 15:49:55.878417 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 105/203] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Dec 16 15:49:55 2021] GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:49:56.181636 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-cb7aed98-3eb7-47ee-add4-ff7970c3458d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:56.182810 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-cb7aed98-3eb7-47ee-add4-ff7970c3458d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:56.189604 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cb7aed98-3eb7-47ee-add4-ff7970c3458d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:56.190019 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cb7aed98-3eb7-47ee-add4-ff7970c3458d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:56.190965 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cb7aed98-3eb7-47ee-add4-ff7970c3458d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:56.191581 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cb7aed98-3eb7-47ee-add4-ff7970c3458d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:56.281340 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-e308da08-831c-47b4-84ca-8a06cdefee63 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:56.281977 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-e308da08-831c-47b4-84ca-8a06cdefee63 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:56.288259 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e308da08-831c-47b4-84ca-8a06cdefee63 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:56.288698 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e308da08-831c-47b4-84ca-8a06cdefee63 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:56.289485 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e308da08-831c-47b4-84ca-8a06cdefee63 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:56.289905 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e308da08-831c-47b4-84ca-8a06cdefee63 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:56.352044 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-cb7aed98-3eb7-47ee-add4-ff7970c3458d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 14 microversion: 2.1 time: 0.174907 Dec 16 15:49:56.353662 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 99/204] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:49:56 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 14 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:49:56.449752 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-e308da08-831c-47b4-84ca-8a06cdefee63 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:56.458978 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-e308da08-831c-47b4-84ca-8a06cdefee63 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1521 microversion: 2.1 time: 0.181679 Dec 16 15:49:56.468666 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 106/205] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:56 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:56.535826 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-2449cf32-0420-4bcd-9086-e07e609951b6 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] Action: 'create', calling method: .version_select at 0x7fed5e1cb280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2023336193"}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:56.891677 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ab162db2-4130-4119-b760-4f303fff6dee tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:56.894232 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-ab162db2-4130-4119-b760-4f303fff6dee tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:56.904763 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ab162db2-4130-4119-b760-4f303fff6dee tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:56.905374 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ab162db2-4130-4119-b760-4f303fff6dee tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:56.906421 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ab162db2-4130-4119-b760-4f303fff6dee tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:56.907579 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ab162db2-4130-4119-b760-4f303fff6dee tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:56.939727 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-2449cf32-0420-4bcd-9086-e07e609951b6 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.584376 Dec 16 15:49:56.940552 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 100/206] 10.222.0.31 () {60 vars in 1154 bytes} [Thu Dec 16 15:49:56 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 586 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 16 15:49:56.954197 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-cb4f7f0c-b0a1-402d-bf8c-d9dc65e23c8c tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] Calling method '.version_select at 0x7fed5e1699d0>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:57.079333 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-cb4f7f0c-b0a1-402d-bf8c-d9dc65e23c8c tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/64742629-c9db-437f-bfbb-7c00df423cd4" status: 200 len: 345 microversion: 2.1 time: 0.130504 Dec 16 15:49:57.080515 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 101/207] 10.222.0.31 () {58 vars in 1244 bytes} [Thu Dec 16 15:49:56 2021] GET /compute/v2.1/os-volumes/64742629-c9db-437f-bfbb-7c00df423cd4 => generated 345 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:49:57.105666 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-ab162db2-4130-4119-b760-4f303fff6dee tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.219521 Dec 16 15:49:57.106811 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 107/208] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Dec 16 15:49:56 2021] GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc/os-volume_attachments => generated 25 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 16 15:49:57.302574 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-b1864749-2ddc-4b6e-9bf7-71c3b5ee1373 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1169578660", "imageRef": "2a1434ad-0c2c-4725-baad-a605624baf01", "flavorRef": "452", "networks": [{"uuid": "4e96172c-0b71-4de2-95ab-4226e7a02984"}]}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:57.361050 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.network.neutron [None req-b1864749-2ddc-4b6e-9bf7-71c3b5ee1373 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] validate_networks() for [('4e96172c-0b71-4de2-95ab-4226e7a02984', None, None, None, None, None)] {{(pid=122398) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 15:49:57.364358 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-8bf9d7c5-2afe-413f-ae32-861d0c72ccb5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:57.365094 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-8bf9d7c5-2afe-413f-ae32-861d0c72ccb5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:57.371142 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8bf9d7c5-2afe-413f-ae32-861d0c72ccb5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:57.371766 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8bf9d7c5-2afe-413f-ae32-861d0c72ccb5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:57.372566 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8bf9d7c5-2afe-413f-ae32-861d0c72ccb5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:57.373018 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8bf9d7c5-2afe-413f-ae32-861d0c72ccb5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:57.459245 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-8bf9d7c5-2afe-413f-ae32-861d0c72ccb5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 14 microversion: 2.1 time: 0.098168 Dec 16 15:49:57.463904 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 108/209] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:49:57 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:49:57.475894 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-467b9101-00b9-4c55-8a7e-4eac468d319d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:57.478116 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-467b9101-00b9-4c55-8a7e-4eac468d319d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:57.490797 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-467b9101-00b9-4c55-8a7e-4eac468d319d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:57.491292 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-467b9101-00b9-4c55-8a7e-4eac468d319d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:57.492213 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-467b9101-00b9-4c55-8a7e-4eac468d319d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:57.492693 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-467b9101-00b9-4c55-8a7e-4eac468d319d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:57.765857 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-467b9101-00b9-4c55-8a7e-4eac468d319d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:57.779743 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-467b9101-00b9-4c55-8a7e-4eac468d319d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1521 microversion: 2.1 time: 0.307541 Dec 16 15:49:57.780895 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 109/210] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:57 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:49:57.875043 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-b1864749-2ddc-4b6e-9bf7-71c3b5ee1373 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Flavor limits 0:0:0 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 15:49:57.875482 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-b1864749-2ddc-4b6e-9bf7-71c3b5ee1373 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Image limits 0:0:0 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 15:49:57.876006 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-b1864749-2ddc-4b6e-9bf7-71c3b5ee1373 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Flavor pref 0:0:0 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 15:49:57.876413 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-b1864749-2ddc-4b6e-9bf7-71c3b5ee1373 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Image pref 0:0:0 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 15:49:57.876907 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-b1864749-2ddc-4b6e-9bf7-71c3b5ee1373 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 15:49:57.889092 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b1864749-2ddc-4b6e-9bf7-71c3b5ee1373 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:57.889665 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b1864749-2ddc-4b6e-9bf7-71c3b5ee1373 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:57.890610 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b1864749-2ddc-4b6e-9bf7-71c3b5ee1373 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:57.891413 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b1864749-2ddc-4b6e-9bf7-71c3b5ee1373 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:57.910090 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.quota [None req-b1864749-2ddc-4b6e-9bf7-71c3b5ee1373 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Getting quotas for project 44bf2643f52c4cc5aa01ae68ef13e12f. Resources: {'instances', 'ram', 'cores'} {{(pid=122398) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:49:57.914562 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.quota [None req-b1864749-2ddc-4b6e-9bf7-71c3b5ee1373 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Getting quotas for user 9b1c255006524ad9b700c0711ecbd569 and project 44bf2643f52c4cc5aa01ae68ef13e12f. Resources: {'instances', 'ram', 'cores'} {{(pid=122398) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:49:57.926660 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-b1864749-2ddc-4b6e-9bf7-71c3b5ee1373 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Going to run 1 instances... {{(pid=122398) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 15:49:57.929467 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-b1864749-2ddc-4b6e-9bf7-71c3b5ee1373 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a1434ad-0c2c-4725-baad-a605624baf01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122398) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 15:49:57.979042 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-b1864749-2ddc-4b6e-9bf7-71c3b5ee1373 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680273 Dec 16 15:49:57.979704 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 102/211] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Dec 16 15:49:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 15:49:57.989937 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-0315940c-d2e7-42ab-943a-fea020425997 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:57.990870 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-0315940c-d2e7-42ab-943a-fea020425997 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:58.054874 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-0315940c-d2e7-42ab-943a-fea020425997 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:58.063261 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-0315940c-d2e7-42ab-943a-fea020425997 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4" status: 200 len: 1218 microversion: 2.1 time: 0.077281 Dec 16 15:49:58.064254 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 110/212] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:57 2021] GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4 => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:58.093293 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-c14e9f3d-1902-4ac0-95d3-727859dd68c6 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] Calling method '.version_select at 0x7fed5e20fa60>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:58.169046 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-c14e9f3d-1902-4ac0-95d3-727859dd68c6 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/64742629-c9db-437f-bfbb-7c00df423cd4" status: 200 len: 346 microversion: 2.1 time: 0.079613 Dec 16 15:49:58.170789 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 103/213] 10.222.0.31 () {58 vars in 1244 bytes} [Thu Dec 16 15:49:58 2021] GET /compute/v2.1/os-volumes/64742629-c9db-437f-bfbb-7c00df423cd4 => generated 346 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:49:58.182065 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-16691d59-4745-4398-b555-107a352a0c6e tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] Action: 'create', calling method: .version_select at 0x7fed5eb7af70>, body: {"snapshot": {"volume_id": "64742629-c9db-437f-bfbb-7c00df423cd4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1961860239"}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:58.385799 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-16691d59-4745-4398-b555-107a352a0c6e tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] 10.222.0.31 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.207736 Dec 16 15:49:58.386438 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 111/214] 10.222.0.31 () {60 vars in 1161 bytes} [Thu Dec 16 15:49:58 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:49:58.396876 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-b95d9752-c2c5-4abf-86a1-d79b2ba94f68 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] Calling method '.version_select at 0x7fed5e169dc0>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:58.446043 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-b95d9752-c2c5-4abf-86a1-d79b2ba94f68 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/a0aaed37-5865-42f1-89fd-1f5b70c96ec9" status: 200 len: 287 microversion: 2.1 time: 0.053380 Dec 16 15:49:58.448880 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 104/215] 10.222.0.31 () {58 vars in 1250 bytes} [Thu Dec 16 15:49:58 2021] GET /compute/v2.1/os-snapshots/a0aaed37-5865-42f1-89fd-1f5b70c96ec9 => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:49:58.458493 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-fda328b8-62c8-41d0-baca-42a9041462bb tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] Calling method '.version_select at 0x7fed5e917310>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:58.473706 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-d2c6101d-a463-4022-83c3-5a6caf23f320 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:58.475477 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-d2c6101d-a463-4022-83c3-5a6caf23f320 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:58.487300 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d2c6101d-a463-4022-83c3-5a6caf23f320 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:58.487836 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d2c6101d-a463-4022-83c3-5a6caf23f320 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:58.488856 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d2c6101d-a463-4022-83c3-5a6caf23f320 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:58.489365 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d2c6101d-a463-4022-83c3-5a6caf23f320 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:58.516780 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-fda328b8-62c8-41d0-baca-42a9041462bb tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.063012 Dec 16 15:49:58.521882 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 112/216] 10.222.0.31 () {58 vars in 1139 bytes} [Thu Dec 16 15:49:58 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:49:58.533469 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-a69be49d-dce0-4f10-868c-91c0b8512839 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] Calling method '.version_select at 0x7fed5e8f7550>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:58.568733 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-a69be49d-dce0-4f10-868c-91c0b8512839 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/a0aaed37-5865-42f1-89fd-1f5b70c96ec9" status: 200 len: 287 microversion: 2.1 time: 0.040285 Dec 16 15:49:58.570011 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 113/217] 10.222.0.31 () {58 vars in 1250 bytes} [Thu Dec 16 15:49:58 2021] GET /compute/v2.1/os-snapshots/a0aaed37-5865-42f1-89fd-1f5b70c96ec9 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:49:58.586927 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-d2c6101d-a463-4022-83c3-5a6caf23f320 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 5186 microversion: 2.1 time: 0.118916 Dec 16 15:49:58.589441 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 105/218] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:49:58 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 5186 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:58.796100 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-f8e8c878-4aec-4653-820e-be12721aa251 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:58.796749 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-f8e8c878-4aec-4653-820e-be12721aa251 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:58.804011 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f8e8c878-4aec-4653-820e-be12721aa251 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:58.804359 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f8e8c878-4aec-4653-820e-be12721aa251 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:58.805142 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f8e8c878-4aec-4653-820e-be12721aa251 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:58.805606 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f8e8c878-4aec-4653-820e-be12721aa251 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:58.963641 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-f8e8c878-4aec-4653-820e-be12721aa251 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:58.971813 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-f8e8c878-4aec-4653-820e-be12721aa251 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1501 microversion: 2.1 time: 0.179533 Dec 16 15:49:58.972904 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 114/219] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:58 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1501 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:58.993503 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-18644e11-7869-4971-90a7-49d0d269a557 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:58.994628 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-18644e11-7869-4971-90a7-49d0d269a557 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:59.007760 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-18644e11-7869-4971-90a7-49d0d269a557 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:59.007760 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-18644e11-7869-4971-90a7-49d0d269a557 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:59.009554 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-18644e11-7869-4971-90a7-49d0d269a557 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:59.010500 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-18644e11-7869-4971-90a7-49d0d269a557 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:59.082724 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-fa2b4a00-fe7c-4b66-ba2d-64eee0ee0c53 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:59.083246 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-fa2b4a00-fe7c-4b66-ba2d-64eee0ee0c53 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:59.092787 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-fa2b4a00-fe7c-4b66-ba2d-64eee0ee0c53 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:59.097561 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-fa2b4a00-fe7c-4b66-ba2d-64eee0ee0c53 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:59.098835 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-fa2b4a00-fe7c-4b66-ba2d-64eee0ee0c53 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:59.099724 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-fa2b4a00-fe7c-4b66-ba2d-64eee0ee0c53 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:59.177273 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-fa2b4a00-fe7c-4b66-ba2d-64eee0ee0c53 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:59.187763 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-fa2b4a00-fe7c-4b66-ba2d-64eee0ee0c53 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4" status: 200 len: 1270 microversion: 2.1 time: 0.109951 Dec 16 15:49:59.188340 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 115/220] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:59 2021] GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4 => generated 1270 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:49:59.222700 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-18644e11-7869-4971-90a7-49d0d269a557 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:49:59.240851 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-18644e11-7869-4971-90a7-49d0d269a557 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1516 microversion: 2.1 time: 0.255278 Dec 16 15:49:59.242087 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 106/221] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:49:58 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1516 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:49:59.588234 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-975dca2c-4034-464b-bf6c-5c055f770d92 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] Calling method '.version_select at 0x7fed5ea28af0>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:49:59.599325 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-5ca4d253-3c61-40cb-9de3-4a8ac8e8da3e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:49:59.602198 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-5ca4d253-3c61-40cb-9de3-4a8ac8e8da3e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:49:59.616399 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5ca4d253-3c61-40cb-9de3-4a8ac8e8da3e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:59.617318 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5ca4d253-3c61-40cb-9de3-4a8ac8e8da3e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:59.619498 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5ca4d253-3c61-40cb-9de3-4a8ac8e8da3e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:49:59.620160 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5ca4d253-3c61-40cb-9de3-4a8ac8e8da3e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:49:59.651088 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-975dca2c-4034-464b-bf6c-5c055f770d92 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/a0aaed37-5865-42f1-89fd-1f5b70c96ec9" status: 200 len: 287 microversion: 2.1 time: 0.065076 Dec 16 15:49:59.651088 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 116/222] 10.222.0.31 () {58 vars in 1250 bytes} [Thu Dec 16 15:49:59 2021] GET /compute/v2.1/os-snapshots/a0aaed37-5865-42f1-89fd-1f5b70c96ec9 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:50:00.204362 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-2172aa4b-6513-4bb9-a23c-14445472c7a6 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:00.206115 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-2172aa4b-6513-4bb9-a23c-14445472c7a6 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:00.212242 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2172aa4b-6513-4bb9-a23c-14445472c7a6 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:00.213012 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2172aa4b-6513-4bb9-a23c-14445472c7a6 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:00.214050 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2172aa4b-6513-4bb9-a23c-14445472c7a6 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:00.214980 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2172aa4b-6513-4bb9-a23c-14445472c7a6 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:00.286802 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-2172aa4b-6513-4bb9-a23c-14445472c7a6 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:00.294788 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-2172aa4b-6513-4bb9-a23c-14445472c7a6 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4" status: 200 len: 1270 microversion: 2.1 time: 0.094673 Dec 16 15:50:00.295369 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 117/223] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:00 2021] GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4 => generated 1270 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:00.659734 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-780898dd-cb55-47d7-bb60-8d3842318a13 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] Calling method '.version_select at 0x7fed5e8dd0d0>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:00.712927 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-780898dd-cb55-47d7-bb60-8d3842318a13 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/a0aaed37-5865-42f1-89fd-1f5b70c96ec9" status: 200 len: 287 microversion: 2.1 time: 0.058390 Dec 16 15:50:00.713664 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 118/224] 10.222.0.31 () {58 vars in 1250 bytes} [Thu Dec 16 15:50:00 2021] GET /compute/v2.1/os-snapshots/a0aaed37-5865-42f1-89fd-1f5b70c96ec9 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:50:01.311606 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-6b88ec82-ae73-4fc0-b712-63f3111a0064 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:01.312225 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-6b88ec82-ae73-4fc0-b712-63f3111a0064 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:01.318264 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6b88ec82-ae73-4fc0-b712-63f3111a0064 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:01.318610 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6b88ec82-ae73-4fc0-b712-63f3111a0064 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:01.319384 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6b88ec82-ae73-4fc0-b712-63f3111a0064 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:01.319838 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6b88ec82-ae73-4fc0-b712-63f3111a0064 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:01.379927 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-6b88ec82-ae73-4fc0-b712-63f3111a0064 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:01.387534 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-6b88ec82-ae73-4fc0-b712-63f3111a0064 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4" status: 200 len: 1270 microversion: 2.1 time: 0.079635 Dec 16 15:50:01.388229 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 119/225] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:01 2021] GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4 => generated 1270 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:01.723986 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-efe484a9-bcb6-4836-825b-0690e7856d54 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] Calling method '.version_select at 0x7fed5eacab80>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:01.755497 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-efe484a9-bcb6-4836-825b-0690e7856d54 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/a0aaed37-5865-42f1-89fd-1f5b70c96ec9" status: 200 len: 287 microversion: 2.1 time: 0.035160 Dec 16 15:50:01.756283 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 120/226] 10.222.0.31 () {58 vars in 1250 bytes} [Thu Dec 16 15:50:01 2021] GET /compute/v2.1/os-snapshots/a0aaed37-5865-42f1-89fd-1f5b70c96ec9 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:50:01.793462 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-5ca4d253-3c61-40cb-9de3-4a8ac8e8da3e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 18003 microversion: 2.1 time: 2.198555 Dec 16 15:50:01.794782 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 107/227] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:49:59 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 18003 bytes in 2201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 15:50:02.404550 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-2d6784a6-108d-41ed-929b-e7e3dce7811f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:02.405738 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-2d6784a6-108d-41ed-929b-e7e3dce7811f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:02.415312 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2d6784a6-108d-41ed-929b-e7e3dce7811f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:02.415799 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2d6784a6-108d-41ed-929b-e7e3dce7811f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:02.416976 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2d6784a6-108d-41ed-929b-e7e3dce7811f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:02.417548 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2d6784a6-108d-41ed-929b-e7e3dce7811f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:02.489116 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-2d6784a6-108d-41ed-929b-e7e3dce7811f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:02.497690 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-2d6784a6-108d-41ed-929b-e7e3dce7811f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4" status: 200 len: 1276 microversion: 2.1 time: 0.097371 Dec 16 15:50:02.498256 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 121/228] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:02 2021] GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4 => generated 1276 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:02.768383 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-ccb7bc6b-dabf-4b8a-b889-5a6ef31da1ff tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] Calling method '.version_select at 0x7fed5eb4c8b0>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:02.809199 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-ccb7bc6b-dabf-4b8a-b889-5a6ef31da1ff tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/a0aaed37-5865-42f1-89fd-1f5b70c96ec9" status: 200 len: 288 microversion: 2.1 time: 0.045268 Dec 16 15:50:02.809883 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 108/229] 10.222.0.31 () {58 vars in 1250 bytes} [Thu Dec 16 15:50:02 2021] GET /compute/v2.1/os-snapshots/a0aaed37-5865-42f1-89fd-1f5b70c96ec9 => generated 288 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:50:02.811047 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-a153302f-3a0d-4d2a-8bbb-3e035ca78aa9 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:02.812955 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-a153302f-3a0d-4d2a-8bbb-3e035ca78aa9 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:02.818211 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-0e7bfa10-f3e1-4f1f-989c-8c2a47440704 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:02.819414 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-0e7bfa10-f3e1-4f1f-989c-8c2a47440704 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:02.822738 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a153302f-3a0d-4d2a-8bbb-3e035ca78aa9 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:02.823180 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a153302f-3a0d-4d2a-8bbb-3e035ca78aa9 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:02.823982 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a153302f-3a0d-4d2a-8bbb-3e035ca78aa9 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:02.824409 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a153302f-3a0d-4d2a-8bbb-3e035ca78aa9 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:02.946643 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-a153302f-3a0d-4d2a-8bbb-3e035ca78aa9 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 18871 microversion: 2.1 time: 0.142966 Dec 16 15:50:02.947345 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 122/230] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:50:02 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 18871 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 15:50:02.955422 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-a5a71c1c-16ee-4c9a-b32b-70e1c8c3ddc1 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] Calling method '.version_select at 0x7fed5ea28d30>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:03.021578 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0e7bfa10-f3e1-4f1f-989c-8c2a47440704 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:03.022483 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0e7bfa10-f3e1-4f1f-989c-8c2a47440704 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:03.023796 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0e7bfa10-f3e1-4f1f-989c-8c2a47440704 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:03.024496 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0e7bfa10-f3e1-4f1f-989c-8c2a47440704 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:03.058191 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.objects.instance [None req-0e7bfa10-f3e1-4f1f-989c-8c2a47440704 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lazy-loading 'flavor' on Instance uuid 05750574-60a7-44f6-8fd6-d2fd52b57e91 {{(pid=122398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:50:03.089784 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-a5a71c1c-16ee-4c9a-b32b-70e1c8c3ddc1 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] 10.222.0.31 "DELETE /compute/v2.1/os-snapshots/a0aaed37-5865-42f1-89fd-1f5b70c96ec9" status: 202 len: 0 microversion: 2.1 time: 0.141011 Dec 16 15:50:03.090684 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 123/231] 10.222.0.31 () {58 vars in 1253 bytes} [Thu Dec 16 15:50:02 2021] DELETE /compute/v2.1/os-snapshots/a0aaed37-5865-42f1-89fd-1f5b70c96ec9 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:50:03.099780 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-cdc438ca-a901-4ecd-a301-67167f2ed404 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] Calling method '.version_select at 0x7fed5e8dd3a0>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:03.142429 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-cdc438ca-a901-4ecd-a301-67167f2ed404 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/a0aaed37-5865-42f1-89fd-1f5b70c96ec9" status: 200 len: 287 microversion: 2.1 time: 0.047144 Dec 16 15:50:03.149368 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 124/232] 10.222.0.31 () {58 vars in 1250 bytes} [Thu Dec 16 15:50:03 2021] GET /compute/v2.1/os-snapshots/a0aaed37-5865-42f1-89fd-1f5b70c96ec9 => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:50:03.180611 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-0e7bfa10-f3e1-4f1f-989c-8c2a47440704 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "POST /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91/action" status: 200 len: 32 microversion: 2.1 time: 0.367228 Dec 16 15:50:03.181226 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 109/233] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:50:02 2021] POST /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91/action => generated 32 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:50:03.191177 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-963f16ce-4afb-431c-877b-c07433c521d3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:03.191917 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-963f16ce-4afb-431c-877b-c07433c521d3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:03.198119 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-963f16ce-4afb-431c-877b-c07433c521d3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:03.198488 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-963f16ce-4afb-431c-877b-c07433c521d3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:03.205738 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-963f16ce-4afb-431c-877b-c07433c521d3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:03.205738 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-963f16ce-4afb-431c-877b-c07433c521d3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:03.405975 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-963f16ce-4afb-431c-877b-c07433c521d3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:03.419437 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-963f16ce-4afb-431c-877b-c07433c521d3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.232188 Dec 16 15:50:03.421326 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 125/234] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:03 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:50:03.516037 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-734259c8-1ace-40db-b5f0-b3624a36997c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:03.516946 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-734259c8-1ace-40db-b5f0-b3624a36997c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:03.525459 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-734259c8-1ace-40db-b5f0-b3624a36997c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:03.525978 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-734259c8-1ace-40db-b5f0-b3624a36997c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:03.527143 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-734259c8-1ace-40db-b5f0-b3624a36997c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:03.527639 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-734259c8-1ace-40db-b5f0-b3624a36997c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:03.689696 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-734259c8-1ace-40db-b5f0-b3624a36997c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:03.699080 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-734259c8-1ace-40db-b5f0-b3624a36997c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4" status: 200 len: 1318 microversion: 2.1 time: 0.187152 Dec 16 15:50:03.700065 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 110/235] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:03 2021] GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:03.823800 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-d08a2e46-9bfa-4f13-94d4-25124e9bdae4 req-22ad36ee-7db1-4108-b239-5a02b12ce094 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f1cffca-44cf-40b7-9216-7d78fdbef5b4", "tag": "eb7f3056-2f47-436e-8398-5620ee86da73"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:03.825681 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:50:03.825681 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:50:03.841598 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-d08a2e46-9bfa-4f13-94d4-25124e9bdae4 req-22ad36ee-7db1-4108-b239-5a02b12ce094 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:03.842044 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-d08a2e46-9bfa-4f13-94d4-25124e9bdae4 req-22ad36ee-7db1-4108-b239-5a02b12ce094 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:03.853498 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-d08a2e46-9bfa-4f13-94d4-25124e9bdae4 req-22ad36ee-7db1-4108-b239-5a02b12ce094 service nova] Creating event network-changed:eb7f3056-2f47-436e-8398-5620ee86da73 for instance 4f1cffca-44cf-40b7-9216-7d78fdbef5b4 on hv-cinder-78447 Dec 16 15:50:03.858943 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-d08a2e46-9bfa-4f13-94d4-25124e9bdae4 req-22ad36ee-7db1-4108-b239-5a02b12ce094 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048324 Dec 16 15:50:03.859546 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 126/236] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:50:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:50:03.959934 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-a9f1c0e9-edab-4699-9b76-dc38618baa63 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:03.961617 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-a9f1c0e9-edab-4699-9b76-dc38618baa63 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:03.969223 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a9f1c0e9-edab-4699-9b76-dc38618baa63 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:03.969716 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a9f1c0e9-edab-4699-9b76-dc38618baa63 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:03.970575 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a9f1c0e9-edab-4699-9b76-dc38618baa63 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:03.971006 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a9f1c0e9-edab-4699-9b76-dc38618baa63 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:04.062459 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-a9f1c0e9-edab-4699-9b76-dc38618baa63 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 20330 microversion: 2.1 time: 0.106137 Dec 16 15:50:04.063105 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 111/237] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:50:03 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 20330 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:50:04.156253 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-8a65b596-659a-40e6-a1bf-47f13b7dc160 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] Calling method '.version_select at 0x7fed5e97dc10>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:04.188531 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.wsgi [None req-8a65b596-659a-40e6-a1bf-47f13b7dc160 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] HTTP exception thrown: Snapshot a0aaed37-5865-42f1-89fd-1f5b70c96ec9 could not be found. Dec 16 15:50:04.189145 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-8a65b596-659a-40e6-a1bf-47f13b7dc160 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] Returning 404 to user: Snapshot a0aaed37-5865-42f1-89fd-1f5b70c96ec9 could not be found. {{(pid=122399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:50:04.190012 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-8a65b596-659a-40e6-a1bf-47f13b7dc160 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/a0aaed37-5865-42f1-89fd-1f5b70c96ec9" status: 404 len: 111 microversion: 2.1 time: 0.038682 Dec 16 15:50:04.193732 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 127/238] 10.222.0.31 () {58 vars in 1250 bytes} [Thu Dec 16 15:50:04 2021] GET /compute/v2.1/os-snapshots/a0aaed37-5865-42f1-89fd-1f5b70c96ec9 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:50:04.200482 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-12495255-82ad-4b2d-a98d-60ab6b704aec tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] Calling method '.version_select at 0x7fed5e212e50>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:04.264506 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-12495255-82ad-4b2d-a98d-60ab6b704aec tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/64742629-c9db-437f-bfbb-7c00df423cd4" status: 202 len: 0 microversion: 2.1 time: 0.069117 Dec 16 15:50:04.265071 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 112/239] 10.222.0.31 () {58 vars in 1247 bytes} [Thu Dec 16 15:50:04 2021] DELETE /compute/v2.1/os-volumes/64742629-c9db-437f-bfbb-7c00df423cd4 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:50:04.273367 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-9afdae11-1575-4fce-b4f5-c4e44db33b47 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] Calling method '.version_select at 0x7fed5ead7e50>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:04.324222 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-9afdae11-1575-4fce-b4f5-c4e44db33b47 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/64742629-c9db-437f-bfbb-7c00df423cd4" status: 200 len: 345 microversion: 2.1 time: 0.054296 Dec 16 15:50:04.324986 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 128/240] 10.222.0.31 () {58 vars in 1244 bytes} [Thu Dec 16 15:50:04 2021] GET /compute/v2.1/os-volumes/64742629-c9db-437f-bfbb-7c00df423cd4 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:50:04.439478 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-39c9f8c6-17bf-4d1a-96c4-9c70083cb71d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:04.440354 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-39c9f8c6-17bf-4d1a-96c4-9c70083cb71d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:04.450436 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-39c9f8c6-17bf-4d1a-96c4-9c70083cb71d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:04.451391 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-39c9f8c6-17bf-4d1a-96c4-9c70083cb71d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:04.452318 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-39c9f8c6-17bf-4d1a-96c4-9c70083cb71d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:04.452822 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-39c9f8c6-17bf-4d1a-96c4-9c70083cb71d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:04.663144 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-39c9f8c6-17bf-4d1a-96c4-9c70083cb71d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:04.672227 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-39c9f8c6-17bf-4d1a-96c4-9c70083cb71d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.237974 Dec 16 15:50:04.673673 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 113/241] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:04 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:04.716659 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-64788bff-7c73-43a3-b9d7-9107d1f58be4 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:04.717664 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-64788bff-7c73-43a3-b9d7-9107d1f58be4 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:04.724112 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-64788bff-7c73-43a3-b9d7-9107d1f58be4 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:04.724644 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-64788bff-7c73-43a3-b9d7-9107d1f58be4 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:04.725732 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-64788bff-7c73-43a3-b9d7-9107d1f58be4 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:04.726228 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-64788bff-7c73-43a3-b9d7-9107d1f58be4 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:04.885121 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-64788bff-7c73-43a3-b9d7-9107d1f58be4 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:04.894973 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-64788bff-7c73-43a3-b9d7-9107d1f58be4 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4" status: 200 len: 1318 microversion: 2.1 time: 0.181043 Dec 16 15:50:04.895762 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 129/242] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:04 2021] GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:05.074021 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-276f89b8-a1f8-4653-8e88-f43aba549653 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:05.075000 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-276f89b8-a1f8-4653-8e88-f43aba549653 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:05.081283 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-276f89b8-a1f8-4653-8e88-f43aba549653 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:05.081760 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-276f89b8-a1f8-4653-8e88-f43aba549653 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:05.082527 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-276f89b8-a1f8-4653-8e88-f43aba549653 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:05.082952 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-276f89b8-a1f8-4653-8e88-f43aba549653 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:05.166472 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-276f89b8-a1f8-4653-8e88-f43aba549653 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 22064 microversion: 2.1 time: 0.096040 Dec 16 15:50:05.167078 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 114/243] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:50:05 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 22064 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:50:05.337342 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-a793a5d2-eebd-40e5-b743-56c0ad6ad755 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] Calling method '.version_select at 0x7fed5e8f7a60>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:05.367747 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.wsgi [None req-a793a5d2-eebd-40e5-b743-56c0ad6ad755 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] HTTP exception thrown: Volume 64742629-c9db-437f-bfbb-7c00df423cd4 could not be found. Dec 16 15:50:05.368314 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-a793a5d2-eebd-40e5-b743-56c0ad6ad755 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] Returning 404 to user: Volume 64742629-c9db-437f-bfbb-7c00df423cd4 could not be found. {{(pid=122399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:50:05.369193 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-a793a5d2-eebd-40e5-b743-56c0ad6ad755 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/64742629-c9db-437f-bfbb-7c00df423cd4" status: 404 len: 109 microversion: 2.1 time: 0.035834 Dec 16 15:50:05.369933 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 130/244] 10.222.0.31 () {58 vars in 1244 bytes} [Thu Dec 16 15:50:05 2021] GET /compute/v2.1/os-volumes/64742629-c9db-437f-bfbb-7c00df423cd4 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:50:05.384393 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-91bd6a75-176d-420a-ae96-c3c417ed3bb2 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] Calling method '.version_select at 0x7fed5e235430>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:05.416619 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.wsgi [None req-91bd6a75-176d-420a-ae96-c3c417ed3bb2 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] HTTP exception thrown: Volume 64742629-c9db-437f-bfbb-7c00df423cd4 could not be found. Dec 16 15:50:05.417277 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-91bd6a75-176d-420a-ae96-c3c417ed3bb2 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] Returning 404 to user: Volume 64742629-c9db-437f-bfbb-7c00df423cd4 could not be found. {{(pid=122398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:50:05.418213 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-91bd6a75-176d-420a-ae96-c3c417ed3bb2 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/64742629-c9db-437f-bfbb-7c00df423cd4" status: 404 len: 109 microversion: 2.1 time: 0.038007 Dec 16 15:50:05.418980 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 115/245] 10.222.0.31 () {58 vars in 1247 bytes} [Thu Dec 16 15:50:05 2021] DELETE /compute/v2.1/os-volumes/64742629-c9db-437f-bfbb-7c00df423cd4 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:50:05.427291 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-303cf4c9-584c-4823-b7b1-29a3992b3cf7 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] Calling method '.version_select at 0x7fed5eaf4af0>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:05.455729 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.wsgi [None req-303cf4c9-584c-4823-b7b1-29a3992b3cf7 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] HTTP exception thrown: Volume 64742629-c9db-437f-bfbb-7c00df423cd4 could not be found. Dec 16 15:50:05.457572 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-303cf4c9-584c-4823-b7b1-29a3992b3cf7 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] Returning 404 to user: Volume 64742629-c9db-437f-bfbb-7c00df423cd4 could not be found. {{(pid=122399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:50:05.457572 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-303cf4c9-584c-4823-b7b1-29a3992b3cf7 tempest-VolumesSnapshotsTestJSON-566678792 tempest-VolumesSnapshotsTestJSON-566678792-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/64742629-c9db-437f-bfbb-7c00df423cd4" status: 404 len: 109 microversion: 2.1 time: 0.033812 Dec 16 15:50:05.458018 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 131/246] 10.222.0.31 () {58 vars in 1244 bytes} [Thu Dec 16 15:50:05 2021] GET /compute/v2.1/os-volumes/64742629-c9db-437f-bfbb-7c00df423cd4 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:50:05.692473 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-c648790f-5652-4d8a-a580-c73da4e6feca tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:05.693283 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-c648790f-5652-4d8a-a580-c73da4e6feca tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:05.700202 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c648790f-5652-4d8a-a580-c73da4e6feca tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:05.700673 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c648790f-5652-4d8a-a580-c73da4e6feca tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:05.701444 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c648790f-5652-4d8a-a580-c73da4e6feca tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:05.702146 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c648790f-5652-4d8a-a580-c73da4e6feca tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:05.891439 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-c648790f-5652-4d8a-a580-c73da4e6feca tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:05.899510 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-c648790f-5652-4d8a-a580-c73da4e6feca tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.212655 Dec 16 15:50:05.900331 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 116/247] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:05 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:05.914107 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-13ffbc35-a3bc-4346-a1d7-477fe4e15636 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:05.914735 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-13ffbc35-a3bc-4346-a1d7-477fe4e15636 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:05.925076 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-13ffbc35-a3bc-4346-a1d7-477fe4e15636 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:05.926411 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-13ffbc35-a3bc-4346-a1d7-477fe4e15636 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:05.927951 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-13ffbc35-a3bc-4346-a1d7-477fe4e15636 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:05.928592 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-13ffbc35-a3bc-4346-a1d7-477fe4e15636 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:06.197049 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-36fb0174-892e-4a1f-a885-b0891ca74d0e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:06.198021 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-36fb0174-892e-4a1f-a885-b0891ca74d0e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:06.209550 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-36fb0174-892e-4a1f-a885-b0891ca74d0e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:06.210954 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-36fb0174-892e-4a1f-a885-b0891ca74d0e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:06.212078 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-36fb0174-892e-4a1f-a885-b0891ca74d0e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:06.213222 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-36fb0174-892e-4a1f-a885-b0891ca74d0e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:06.228008 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-13ffbc35-a3bc-4346-a1d7-477fe4e15636 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:06.236216 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-13ffbc35-a3bc-4346-a1d7-477fe4e15636 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4" status: 200 len: 1318 microversion: 2.1 time: 0.326870 Dec 16 15:50:06.237370 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 132/248] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:05 2021] GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4 => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:06.305363 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-36fb0174-892e-4a1f-a885-b0891ca74d0e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 23229 microversion: 2.1 time: 0.131269 Dec 16 15:50:06.306758 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 117/249] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:50:06 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 23229 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:50:06.915549 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-db2ced1f-ab36-49e3-baa5-93f4ef62666a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:06.916777 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-db2ced1f-ab36-49e3-baa5-93f4ef62666a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:06.922993 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-db2ced1f-ab36-49e3-baa5-93f4ef62666a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:06.924177 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-db2ced1f-ab36-49e3-baa5-93f4ef62666a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:06.926425 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-db2ced1f-ab36-49e3-baa5-93f4ef62666a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:06.927081 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-db2ced1f-ab36-49e3-baa5-93f4ef62666a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:07.066984 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-db2ced1f-ab36-49e3-baa5-93f4ef62666a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:07.074542 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-db2ced1f-ab36-49e3-baa5-93f4ef62666a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.162594 Dec 16 15:50:07.075153 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 133/250] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:06 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:07.255627 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-0e110c54-66bf-417a-9680-b2a1925dbae2 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:07.256430 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-0e110c54-66bf-417a-9680-b2a1925dbae2 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:07.264478 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0e110c54-66bf-417a-9680-b2a1925dbae2 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:07.264930 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0e110c54-66bf-417a-9680-b2a1925dbae2 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:07.265742 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0e110c54-66bf-417a-9680-b2a1925dbae2 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:07.266385 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0e110c54-66bf-417a-9680-b2a1925dbae2 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:07.317229 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-e72d3a00-39f1-43f8-99d8-8800fb3bbb4b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:07.318658 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-e72d3a00-39f1-43f8-99d8-8800fb3bbb4b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:07.327713 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e72d3a00-39f1-43f8-99d8-8800fb3bbb4b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:07.328151 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e72d3a00-39f1-43f8-99d8-8800fb3bbb4b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:07.329183 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e72d3a00-39f1-43f8-99d8-8800fb3bbb4b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:07.329653 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e72d3a00-39f1-43f8-99d8-8800fb3bbb4b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:07.412204 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-e72d3a00-39f1-43f8-99d8-8800fb3bbb4b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 24349 microversion: 2.1 time: 0.098393 Dec 16 15:50:07.412859 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 134/251] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:50:07 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 24349 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 15:50:07.456613 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-0e110c54-66bf-417a-9680-b2a1925dbae2 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:07.469669 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-0e110c54-66bf-417a-9680-b2a1925dbae2 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4" status: 200 len: 1318 microversion: 2.1 time: 0.216252 Dec 16 15:50:07.469669 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 118/252] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:07 2021] GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:08.092455 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-76669d48-ee5c-4c0f-8782-c18e4e280edb tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:08.093152 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-76669d48-ee5c-4c0f-8782-c18e4e280edb tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:08.099813 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-76669d48-ee5c-4c0f-8782-c18e4e280edb tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:08.100990 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-76669d48-ee5c-4c0f-8782-c18e4e280edb tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:08.102355 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-76669d48-ee5c-4c0f-8782-c18e4e280edb tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:08.102778 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-76669d48-ee5c-4c0f-8782-c18e4e280edb tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:08.256528 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-76669d48-ee5c-4c0f-8782-c18e4e280edb tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:08.264210 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-76669d48-ee5c-4c0f-8782-c18e4e280edb tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.176134 Dec 16 15:50:08.264779 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 135/253] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:08 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:08.424063 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-c01cfd06-4ebf-45d0-af08-ac2b979f2942 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:08.425049 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-c01cfd06-4ebf-45d0-af08-ac2b979f2942 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:08.432551 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c01cfd06-4ebf-45d0-af08-ac2b979f2942 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:08.432949 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c01cfd06-4ebf-45d0-af08-ac2b979f2942 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:08.433785 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c01cfd06-4ebf-45d0-af08-ac2b979f2942 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:08.434275 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c01cfd06-4ebf-45d0-af08-ac2b979f2942 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:08.486433 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-48ef1799-717f-4922-b856-2bf8e36adbf1 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:08.487167 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-48ef1799-717f-4922-b856-2bf8e36adbf1 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:08.493527 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-48ef1799-717f-4922-b856-2bf8e36adbf1 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:08.494015 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-48ef1799-717f-4922-b856-2bf8e36adbf1 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:08.494772 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-48ef1799-717f-4922-b856-2bf8e36adbf1 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:08.495192 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-48ef1799-717f-4922-b856-2bf8e36adbf1 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:08.527928 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-c01cfd06-4ebf-45d0-af08-ac2b979f2942 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 25195 microversion: 2.1 time: 0.106897 Dec 16 15:50:08.528865 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 119/254] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:50:08 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 25195 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:50:08.625144 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-48ef1799-717f-4922-b856-2bf8e36adbf1 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:08.633309 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-48ef1799-717f-4922-b856-2bf8e36adbf1 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4" status: 200 len: 1318 microversion: 2.1 time: 0.150576 Dec 16 15:50:08.634694 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 136/255] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:08 2021] GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:50:08.783582 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-2985ab19-2da9-43d0-9f31-d220d9331b1d tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1381195167", "imageRef": "2a1434ad-0c2c-4725-baad-a605624baf01", "flavorRef": "452"}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:08.852744 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.network.neutron [None req-2985ab19-2da9-43d0-9f31-d220d9331b1d tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] validate_networks() for None {{(pid=122398) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 15:50:09.134313 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-2985ab19-2da9-43d0-9f31-d220d9331b1d tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Flavor limits 0:0:0 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 15:50:09.134731 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-2985ab19-2da9-43d0-9f31-d220d9331b1d tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Image limits 0:0:0 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 15:50:09.135196 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-2985ab19-2da9-43d0-9f31-d220d9331b1d tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Flavor pref 0:0:0 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 15:50:09.135598 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-2985ab19-2da9-43d0-9f31-d220d9331b1d tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Image pref 0:0:0 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 15:50:09.136424 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-2985ab19-2da9-43d0-9f31-d220d9331b1d tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 15:50:09.145482 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2985ab19-2da9-43d0-9f31-d220d9331b1d tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:09.145942 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2985ab19-2da9-43d0-9f31-d220d9331b1d tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:09.146737 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2985ab19-2da9-43d0-9f31-d220d9331b1d tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:09.147193 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2985ab19-2da9-43d0-9f31-d220d9331b1d tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:09.165046 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.quota [None req-2985ab19-2da9-43d0-9f31-d220d9331b1d tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Getting quotas for project 02f0ef78d0784036a0c421741c8de20e. Resources: {'instances', 'ram', 'cores'} {{(pid=122398) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:50:09.170184 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.quota [None req-2985ab19-2da9-43d0-9f31-d220d9331b1d tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Getting quotas for user fab314c4f90b42698961c9a019a7d86a and project 02f0ef78d0784036a0c421741c8de20e. Resources: {'instances', 'ram', 'cores'} {{(pid=122398) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:50:09.186027 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-2985ab19-2da9-43d0-9f31-d220d9331b1d tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Going to run 1 instances... {{(pid=122398) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 15:50:09.188429 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-2985ab19-2da9-43d0-9f31-d220d9331b1d tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a1434ad-0c2c-4725-baad-a605624baf01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122398) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 15:50:09.241140 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-2985ab19-2da9-43d0-9f31-d220d9331b1d tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.461500 Dec 16 15:50:09.246404 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 120/256] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Dec 16 15:50:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 15:50:09.252002 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-73b074f7-b495-486a-9aca-ad83a88d8400 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:09.255777 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-73b074f7-b495-486a-9aca-ad83a88d8400 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:09.280431 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-226988dd-8aae-4f17-a3eb-b6fde3d0d6d1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:09.281040 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-226988dd-8aae-4f17-a3eb-b6fde3d0d6d1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:09.287586 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-226988dd-8aae-4f17-a3eb-b6fde3d0d6d1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:09.288043 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-226988dd-8aae-4f17-a3eb-b6fde3d0d6d1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:09.288980 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-226988dd-8aae-4f17-a3eb-b6fde3d0d6d1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:09.289428 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-226988dd-8aae-4f17-a3eb-b6fde3d0d6d1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:09.319790 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-73b074f7-b495-486a-9aca-ad83a88d8400 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:09.327057 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-73b074f7-b495-486a-9aca-ad83a88d8400 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1215 microversion: 2.1 time: 0.079302 Dec 16 15:50:09.339029 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 137/257] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:09 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1215 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:09.447030 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-226988dd-8aae-4f17-a3eb-b6fde3d0d6d1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:09.455198 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-226988dd-8aae-4f17-a3eb-b6fde3d0d6d1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.178854 Dec 16 15:50:09.465735 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 121/258] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:09 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:09.539270 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-2a220513-80ca-451b-b371-d97fcae6d035 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:09.540325 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-2a220513-80ca-451b-b371-d97fcae6d035 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:09.550318 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2a220513-80ca-451b-b371-d97fcae6d035 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:09.551328 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2a220513-80ca-451b-b371-d97fcae6d035 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:09.554264 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2a220513-80ca-451b-b371-d97fcae6d035 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:09.554895 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2a220513-80ca-451b-b371-d97fcae6d035 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:09.651578 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-67cd0fdd-6c38-4057-8f90-38e637276311 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:09.652414 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-67cd0fdd-6c38-4057-8f90-38e637276311 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:09.661622 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-67cd0fdd-6c38-4057-8f90-38e637276311 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:09.661622 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-67cd0fdd-6c38-4057-8f90-38e637276311 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:09.661622 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-67cd0fdd-6c38-4057-8f90-38e637276311 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:09.661622 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-67cd0fdd-6c38-4057-8f90-38e637276311 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:09.799804 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-67cd0fdd-6c38-4057-8f90-38e637276311 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:09.807051 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-67cd0fdd-6c38-4057-8f90-38e637276311 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4" status: 200 len: 1318 microversion: 2.1 time: 0.159869 Dec 16 15:50:09.807614 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 122/259] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:09 2021] GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:50:10.344533 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-211d6fc3-8436-4b5c-b331-86a1520c7e97 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:10.345233 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-211d6fc3-8436-4b5c-b331-86a1520c7e97 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:10.351857 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-211d6fc3-8436-4b5c-b331-86a1520c7e97 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:10.352295 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-211d6fc3-8436-4b5c-b331-86a1520c7e97 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:10.353067 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-211d6fc3-8436-4b5c-b331-86a1520c7e97 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:10.353597 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-211d6fc3-8436-4b5c-b331-86a1520c7e97 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:10.410456 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-211d6fc3-8436-4b5c-b331-86a1520c7e97 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:10.417788 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-211d6fc3-8436-4b5c-b331-86a1520c7e97 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1219 microversion: 2.1 time: 0.077270 Dec 16 15:50:10.418354 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 123/260] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:10 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:10.475969 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-1d5fe6d3-d088-4f81-aba4-23c29d96f8da tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:10.477366 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-1d5fe6d3-d088-4f81-aba4-23c29d96f8da tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:10.486373 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1d5fe6d3-d088-4f81-aba4-23c29d96f8da tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:10.486840 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1d5fe6d3-d088-4f81-aba4-23c29d96f8da tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:10.487566 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1d5fe6d3-d088-4f81-aba4-23c29d96f8da tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:10.488139 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1d5fe6d3-d088-4f81-aba4-23c29d96f8da tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:10.617753 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-1d5fe6d3-d088-4f81-aba4-23c29d96f8da tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:10.625247 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-1d5fe6d3-d088-4f81-aba4-23c29d96f8da tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.155832 Dec 16 15:50:10.625841 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 124/261] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:10 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:10.772612 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-6e5ee37d-6ffa-4b43-88b6-6c196fa0ae2c req-7a6f189f-576b-4237-b42f-943b9b23b3ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f1cffca-44cf-40b7-9216-7d78fdbef5b4", "name": "network-vif-plugged", "status": "completed", "tag": "eb7f3056-2f47-436e-8398-5620ee86da73"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:10.774204 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:50:10.774204 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:50:10.781294 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-6e5ee37d-6ffa-4b43-88b6-6c196fa0ae2c req-7a6f189f-576b-4237-b42f-943b9b23b3ac service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:10.781761 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-6e5ee37d-6ffa-4b43-88b6-6c196fa0ae2c req-7a6f189f-576b-4237-b42f-943b9b23b3ac service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:10.794048 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-6e5ee37d-6ffa-4b43-88b6-6c196fa0ae2c req-7a6f189f-576b-4237-b42f-943b9b23b3ac service nova] Creating event network-vif-plugged:eb7f3056-2f47-436e-8398-5620ee86da73 for instance 4f1cffca-44cf-40b7-9216-7d78fdbef5b4 on hv-cinder-78447 Dec 16 15:50:10.799047 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-6e5ee37d-6ffa-4b43-88b6-6c196fa0ae2c req-7a6f189f-576b-4237-b42f-943b9b23b3ac service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030025 Dec 16 15:50:10.799626 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 125/262] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:50:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:50:10.824169 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-c57c838d-c329-47ef-a878-0d1160e7c8e4 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:10.824786 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-c57c838d-c329-47ef-a878-0d1160e7c8e4 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:10.830756 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c57c838d-c329-47ef-a878-0d1160e7c8e4 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:10.831222 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c57c838d-c329-47ef-a878-0d1160e7c8e4 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:10.831995 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c57c838d-c329-47ef-a878-0d1160e7c8e4 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:10.832398 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c57c838d-c329-47ef-a878-0d1160e7c8e4 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:10.966605 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-c57c838d-c329-47ef-a878-0d1160e7c8e4 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:10.974271 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-c57c838d-c329-47ef-a878-0d1160e7c8e4 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4" status: 200 len: 1318 microversion: 2.1 time: 0.154084 Dec 16 15:50:10.974808 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 126/263] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:10 2021] GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:50:11.439957 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-9e3f89e7-7ef0-46b7-b4dd-4815174f0c55 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:11.440579 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-9e3f89e7-7ef0-46b7-b4dd-4815174f0c55 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:11.447854 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9e3f89e7-7ef0-46b7-b4dd-4815174f0c55 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:11.448296 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9e3f89e7-7ef0-46b7-b4dd-4815174f0c55 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:11.449097 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9e3f89e7-7ef0-46b7-b4dd-4815174f0c55 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:11.449560 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9e3f89e7-7ef0-46b7-b4dd-4815174f0c55 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:11.510934 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-9e3f89e7-7ef0-46b7-b4dd-4815174f0c55 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:11.519239 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-9e3f89e7-7ef0-46b7-b4dd-4815174f0c55 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1219 microversion: 2.1 time: 0.083112 Dec 16 15:50:11.519835 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 127/264] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:11 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:11.642609 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-975a5555-a02b-49be-b231-fbaf7b41b5c3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:11.643228 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-975a5555-a02b-49be-b231-fbaf7b41b5c3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:11.650222 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-975a5555-a02b-49be-b231-fbaf7b41b5c3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:11.650699 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-975a5555-a02b-49be-b231-fbaf7b41b5c3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:11.651568 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-975a5555-a02b-49be-b231-fbaf7b41b5c3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:11.652117 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-975a5555-a02b-49be-b231-fbaf7b41b5c3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:11.794431 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-975a5555-a02b-49be-b231-fbaf7b41b5c3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:11.801831 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-975a5555-a02b-49be-b231-fbaf7b41b5c3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.163154 Dec 16 15:50:11.802398 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 128/265] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:11 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:11.991547 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-7be34bb0-cc01-43b0-9150-cf8b0a531b34 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:11.992280 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-7be34bb0-cc01-43b0-9150-cf8b0a531b34 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:11.998801 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7be34bb0-cc01-43b0-9150-cf8b0a531b34 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:11.999267 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7be34bb0-cc01-43b0-9150-cf8b0a531b34 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:12.000054 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7be34bb0-cc01-43b0-9150-cf8b0a531b34 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:12.000485 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7be34bb0-cc01-43b0-9150-cf8b0a531b34 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:12.132075 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-7be34bb0-cc01-43b0-9150-cf8b0a531b34 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:12.139892 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-7be34bb0-cc01-43b0-9150-cf8b0a531b34 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4" status: 200 len: 1318 microversion: 2.1 time: 0.151955 Dec 16 15:50:12.140460 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 129/266] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:11 2021] GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:50:12.536356 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-96aac9ea-de2e-4bf4-aa42-3523e2f03d1a tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:12.537018 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-96aac9ea-de2e-4bf4-aa42-3523e2f03d1a tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:12.543720 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-96aac9ea-de2e-4bf4-aa42-3523e2f03d1a tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:12.544167 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-96aac9ea-de2e-4bf4-aa42-3523e2f03d1a tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:12.544944 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-96aac9ea-de2e-4bf4-aa42-3523e2f03d1a tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:12.545375 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-96aac9ea-de2e-4bf4-aa42-3523e2f03d1a tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:12.603728 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-96aac9ea-de2e-4bf4-aa42-3523e2f03d1a tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:12.612296 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-96aac9ea-de2e-4bf4-aa42-3523e2f03d1a tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1219 microversion: 2.1 time: 0.078739 Dec 16 15:50:12.612296 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 130/267] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:12 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:12.645349 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-2a220513-80ca-451b-b371-d97fcae6d035 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 27420 microversion: 2.1 time: 3.110039 Dec 16 15:50:12.646128 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 138/268] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:50:09 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 27420 bytes in 3112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:50:12.823860 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-966e8c7b-0e09-4d6b-9c67-c5c4d121ed66 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:12.824486 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-966e8c7b-0e09-4d6b-9c67-c5c4d121ed66 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:12.831370 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-966e8c7b-0e09-4d6b-9c67-c5c4d121ed66 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:12.831816 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-966e8c7b-0e09-4d6b-9c67-c5c4d121ed66 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:12.832654 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-966e8c7b-0e09-4d6b-9c67-c5c4d121ed66 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:12.833222 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-966e8c7b-0e09-4d6b-9c67-c5c4d121ed66 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:12.964869 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-966e8c7b-0e09-4d6b-9c67-c5c4d121ed66 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:12.972292 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-966e8c7b-0e09-4d6b-9c67-c5c4d121ed66 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.157346 Dec 16 15:50:12.972867 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 131/269] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:12 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:13.161057 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-b0e09512-a831-46e3-868e-de02eff5fefb tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:13.162282 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-b0e09512-a831-46e3-868e-de02eff5fefb tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:13.174577 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b0e09512-a831-46e3-868e-de02eff5fefb tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:13.175323 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b0e09512-a831-46e3-868e-de02eff5fefb tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:13.176611 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b0e09512-a831-46e3-868e-de02eff5fefb tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:13.177328 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b0e09512-a831-46e3-868e-de02eff5fefb tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:13.310235 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-b0e09512-a831-46e3-868e-de02eff5fefb tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:13.318698 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-b0e09512-a831-46e3-868e-de02eff5fefb tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4" status: 200 len: 1318 microversion: 2.1 time: 0.164656 Dec 16 15:50:13.319330 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 139/270] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:13 2021] GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:13.629897 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-cc469efa-b5c3-4f5b-a00e-d02bc16f3245 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:13.630468 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-cc469efa-b5c3-4f5b-a00e-d02bc16f3245 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:13.637283 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cc469efa-b5c3-4f5b-a00e-d02bc16f3245 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:13.637959 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cc469efa-b5c3-4f5b-a00e-d02bc16f3245 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:13.639018 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cc469efa-b5c3-4f5b-a00e-d02bc16f3245 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:13.639602 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cc469efa-b5c3-4f5b-a00e-d02bc16f3245 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:13.659659 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-5ff9cd24-e141-40f8-9d50-ee8149cbba3b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:13.661505 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-5ff9cd24-e141-40f8-9d50-ee8149cbba3b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:13.680924 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5ff9cd24-e141-40f8-9d50-ee8149cbba3b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:13.681383 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5ff9cd24-e141-40f8-9d50-ee8149cbba3b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:13.682212 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5ff9cd24-e141-40f8-9d50-ee8149cbba3b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:13.682644 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5ff9cd24-e141-40f8-9d50-ee8149cbba3b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:13.723861 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-cc469efa-b5c3-4f5b-a00e-d02bc16f3245 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:13.732463 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-cc469efa-b5c3-4f5b-a00e-d02bc16f3245 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1275 microversion: 2.1 time: 0.108144 Dec 16 15:50:13.733191 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 132/271] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:13 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1275 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:13.799118 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-5ff9cd24-e141-40f8-9d50-ee8149cbba3b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 27572 microversion: 2.1 time: 0.146389 Dec 16 15:50:13.799769 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 140/272] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:50:13 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 27572 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 15:50:13.989592 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-5da815c3-c6ea-4773-b538-2fe6c7e0f312 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:13.990538 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-5da815c3-c6ea-4773-b538-2fe6c7e0f312 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:13.998302 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5da815c3-c6ea-4773-b538-2fe6c7e0f312 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:13.999125 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5da815c3-c6ea-4773-b538-2fe6c7e0f312 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:14.000686 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5da815c3-c6ea-4773-b538-2fe6c7e0f312 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:14.001625 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5da815c3-c6ea-4773-b538-2fe6c7e0f312 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:14.178503 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-5da815c3-c6ea-4773-b538-2fe6c7e0f312 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:14.200080 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-5da815c3-c6ea-4773-b538-2fe6c7e0f312 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.214283 Dec 16 15:50:14.207874 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 133/273] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:13 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:14.335891 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-6951f006-a7eb-4f97-81a3-ebdc0da01f11 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:14.351927 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-6951f006-a7eb-4f97-81a3-ebdc0da01f11 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:14.379114 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6951f006-a7eb-4f97-81a3-ebdc0da01f11 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:14.379114 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6951f006-a7eb-4f97-81a3-ebdc0da01f11 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:14.379114 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6951f006-a7eb-4f97-81a3-ebdc0da01f11 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:14.379114 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6951f006-a7eb-4f97-81a3-ebdc0da01f11 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:14.579265 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-6951f006-a7eb-4f97-81a3-ebdc0da01f11 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:14.592032 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-6951f006-a7eb-4f97-81a3-ebdc0da01f11 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4" status: 200 len: 1318 microversion: 2.1 time: 0.259018 Dec 16 15:50:14.592769 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 141/274] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:14 2021] GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:14.762573 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-19aae4fb-5575-4668-837e-5aa9a0a83a4a tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:14.769133 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-19aae4fb-5575-4668-837e-5aa9a0a83a4a tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:14.788449 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-19aae4fb-5575-4668-837e-5aa9a0a83a4a tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:14.789211 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-19aae4fb-5575-4668-837e-5aa9a0a83a4a tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:14.790528 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-19aae4fb-5575-4668-837e-5aa9a0a83a4a tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:14.792763 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-19aae4fb-5575-4668-837e-5aa9a0a83a4a tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:14.812006 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-00a357bc-b5c0-40a7-a296-30ce49ef918f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:14.820163 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-00a357bc-b5c0-40a7-a296-30ce49ef918f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:14.841898 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-00a357bc-b5c0-40a7-a296-30ce49ef918f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:14.843545 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-00a357bc-b5c0-40a7-a296-30ce49ef918f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:14.844854 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-00a357bc-b5c0-40a7-a296-30ce49ef918f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:14.848011 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-00a357bc-b5c0-40a7-a296-30ce49ef918f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:15.004030 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-00a357bc-b5c0-40a7-a296-30ce49ef918f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 27933 microversion: 2.1 time: 0.196227 Dec 16 15:50:15.004795 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 142/275] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:50:14 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 27933 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:50:15.037777 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-19aae4fb-5575-4668-837e-5aa9a0a83a4a tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:15.050352 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-19aae4fb-5575-4668-837e-5aa9a0a83a4a tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1315 microversion: 2.1 time: 0.304463 Dec 16 15:50:15.050936 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 134/276] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:14 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:15.225925 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-b276de79-ebe0-4f45-b098-a7f26a5f843d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:15.227599 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-b276de79-ebe0-4f45-b098-a7f26a5f843d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:15.234710 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b276de79-ebe0-4f45-b098-a7f26a5f843d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:15.235222 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b276de79-ebe0-4f45-b098-a7f26a5f843d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:15.235930 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b276de79-ebe0-4f45-b098-a7f26a5f843d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:15.236358 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b276de79-ebe0-4f45-b098-a7f26a5f843d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:15.384081 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-b276de79-ebe0-4f45-b098-a7f26a5f843d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:15.397014 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-b276de79-ebe0-4f45-b098-a7f26a5f843d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.175474 Dec 16 15:50:15.398231 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 143/277] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:15 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:15.555424 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-c5136648-9051-4539-9d96-10f5be9a61b5 req-6c1fcc7b-9a27-428e-84ba-1592b776674d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57099c29-992b-4d24-9ce5-251ac704d335", "tag": "07e7c44a-e6c2-471c-93ac-f346f0ad0d93"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:15.559093 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:50:15.559093 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:50:15.566707 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-c5136648-9051-4539-9d96-10f5be9a61b5 req-6c1fcc7b-9a27-428e-84ba-1592b776674d service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:15.567428 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-c5136648-9051-4539-9d96-10f5be9a61b5 req-6c1fcc7b-9a27-428e-84ba-1592b776674d service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:15.592174 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-c5136648-9051-4539-9d96-10f5be9a61b5 req-6c1fcc7b-9a27-428e-84ba-1592b776674d service nova] Creating event network-changed:07e7c44a-e6c2-471c-93ac-f346f0ad0d93 for instance 57099c29-992b-4d24-9ce5-251ac704d335 on hv-cinder-78447 Dec 16 15:50:15.597997 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-c5136648-9051-4539-9d96-10f5be9a61b5 req-6c1fcc7b-9a27-428e-84ba-1592b776674d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055452 Dec 16 15:50:15.599239 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 135/278] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:50:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:50:15.620359 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ebbff2d6-a0f2-43ef-b75a-982e1e9b2fae tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:15.621227 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-ebbff2d6-a0f2-43ef-b75a-982e1e9b2fae tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:15.631305 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ebbff2d6-a0f2-43ef-b75a-982e1e9b2fae tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:15.631972 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ebbff2d6-a0f2-43ef-b75a-982e1e9b2fae tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:15.633096 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ebbff2d6-a0f2-43ef-b75a-982e1e9b2fae tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:15.633713 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ebbff2d6-a0f2-43ef-b75a-982e1e9b2fae tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:16.019968 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-963707e3-6635-41ae-9a16-8219f438be17 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:16.030603 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-963707e3-6635-41ae-9a16-8219f438be17 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:16.040758 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-963707e3-6635-41ae-9a16-8219f438be17 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:16.041933 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-963707e3-6635-41ae-9a16-8219f438be17 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:16.043043 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-963707e3-6635-41ae-9a16-8219f438be17 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:16.043631 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-963707e3-6635-41ae-9a16-8219f438be17 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:16.054066 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-ebbff2d6-a0f2-43ef-b75a-982e1e9b2fae tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:16.069825 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-ebbff2d6-a0f2-43ef-b75a-982e1e9b2fae tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4" status: 200 len: 1509 microversion: 2.1 time: 0.451009 Dec 16 15:50:16.070719 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 144/279] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:15 2021] GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4 => generated 1509 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:50:16.075435 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-c5650f4b-421a-455e-ad19-fb87dd88f555 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:16.076041 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-c5650f4b-421a-455e-ad19-fb87dd88f555 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:16.084540 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c5650f4b-421a-455e-ad19-fb87dd88f555 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:16.084992 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c5650f4b-421a-455e-ad19-fb87dd88f555 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:16.085808 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c5650f4b-421a-455e-ad19-fb87dd88f555 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:16.086258 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c5650f4b-421a-455e-ad19-fb87dd88f555 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:16.257795 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-c5650f4b-421a-455e-ad19-fb87dd88f555 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:16.265556 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-c5650f4b-421a-455e-ad19-fb87dd88f555 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1315 microversion: 2.1 time: 0.193663 Dec 16 15:50:16.266120 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 145/280] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:16 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:16.414019 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-c2a8e79a-87e4-425e-9bc1-147c03e88ef3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:16.414618 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-c2a8e79a-87e4-425e-9bc1-147c03e88ef3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:16.420798 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c2a8e79a-87e4-425e-9bc1-147c03e88ef3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:16.421296 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c2a8e79a-87e4-425e-9bc1-147c03e88ef3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:16.422138 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c2a8e79a-87e4-425e-9bc1-147c03e88ef3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:16.422576 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c2a8e79a-87e4-425e-9bc1-147c03e88ef3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:16.555870 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-c2a8e79a-87e4-425e-9bc1-147c03e88ef3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:16.563072 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-c2a8e79a-87e4-425e-9bc1-147c03e88ef3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.152802 Dec 16 15:50:16.563634 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 146/281] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:16 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:50:17.282157 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-f3f05b5b-a199-4c0d-bda5-ad711ea28386 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:17.283005 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-f3f05b5b-a199-4c0d-bda5-ad711ea28386 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:17.290574 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f3f05b5b-a199-4c0d-bda5-ad711ea28386 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:17.291026 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f3f05b5b-a199-4c0d-bda5-ad711ea28386 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:17.291808 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f3f05b5b-a199-4c0d-bda5-ad711ea28386 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:17.292243 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f3f05b5b-a199-4c0d-bda5-ad711ea28386 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:17.427746 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-f3f05b5b-a199-4c0d-bda5-ad711ea28386 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:17.435160 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-f3f05b5b-a199-4c0d-bda5-ad711ea28386 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1315 microversion: 2.1 time: 0.156790 Dec 16 15:50:17.435751 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 147/282] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:17 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:50:17.580381 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-95d93876-41ac-482a-ac59-3ba6853a1464 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:17.581063 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-95d93876-41ac-482a-ac59-3ba6853a1464 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:17.587776 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-95d93876-41ac-482a-ac59-3ba6853a1464 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:17.588226 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-95d93876-41ac-482a-ac59-3ba6853a1464 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:17.589016 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-95d93876-41ac-482a-ac59-3ba6853a1464 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:17.589444 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-95d93876-41ac-482a-ac59-3ba6853a1464 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:17.723548 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-95d93876-41ac-482a-ac59-3ba6853a1464 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:17.731097 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-95d93876-41ac-482a-ac59-3ba6853a1464 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.154844 Dec 16 15:50:17.731666 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 148/283] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:17 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:18.461344 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ada3bfb9-d5e3-40d8-a104-06fb81e5d23c tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:18.461344 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-ada3bfb9-d5e3-40d8-a104-06fb81e5d23c tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:18.462911 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ada3bfb9-d5e3-40d8-a104-06fb81e5d23c tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:18.463491 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ada3bfb9-d5e3-40d8-a104-06fb81e5d23c tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:18.464336 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ada3bfb9-d5e3-40d8-a104-06fb81e5d23c tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:18.464768 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ada3bfb9-d5e3-40d8-a104-06fb81e5d23c tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:18.603562 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-963707e3-6635-41ae-9a16-8219f438be17 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 28174 microversion: 2.1 time: 2.590314 Dec 16 15:50:18.605970 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 136/284] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:50:16 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 28174 bytes in 2594 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 15:50:18.654688 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-ada3bfb9-d5e3-40d8-a104-06fb81e5d23c tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:18.665243 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-ada3bfb9-d5e3-40d8-a104-06fb81e5d23c tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1315 microversion: 2.1 time: 0.216851 Dec 16 15:50:18.677610 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 149/285] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:18 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:18.750603 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-b631b9af-2a43-4aa3-ad82-c64929c1bda1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:18.751744 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-b631b9af-2a43-4aa3-ad82-c64929c1bda1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:18.761193 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b631b9af-2a43-4aa3-ad82-c64929c1bda1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:18.761986 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b631b9af-2a43-4aa3-ad82-c64929c1bda1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:18.763187 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b631b9af-2a43-4aa3-ad82-c64929c1bda1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:18.763620 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b631b9af-2a43-4aa3-ad82-c64929c1bda1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:18.916132 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-b631b9af-2a43-4aa3-ad82-c64929c1bda1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:18.923720 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-b631b9af-2a43-4aa3-ad82-c64929c1bda1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.179336 Dec 16 15:50:18.925593 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 137/286] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:18 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:19.615783 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-12d089eb-6b57-4df1-8df5-6d1d2d2a84ec tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:19.616768 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-12d089eb-6b57-4df1-8df5-6d1d2d2a84ec tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:19.622762 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-12d089eb-6b57-4df1-8df5-6d1d2d2a84ec tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:19.623233 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-12d089eb-6b57-4df1-8df5-6d1d2d2a84ec tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:19.624033 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-12d089eb-6b57-4df1-8df5-6d1d2d2a84ec tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:19.624511 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-12d089eb-6b57-4df1-8df5-6d1d2d2a84ec tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:19.684078 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-8542d647-257c-44cc-8c0f-c1072365680b tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:19.684692 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-8542d647-257c-44cc-8c0f-c1072365680b tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:19.690875 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8542d647-257c-44cc-8c0f-c1072365680b tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:19.691319 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8542d647-257c-44cc-8c0f-c1072365680b tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:19.692089 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8542d647-257c-44cc-8c0f-c1072365680b tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:19.692520 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8542d647-257c-44cc-8c0f-c1072365680b tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:19.705927 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-12d089eb-6b57-4df1-8df5-6d1d2d2a84ec tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 28174 microversion: 2.1 time: 0.093643 Dec 16 15:50:19.706932 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 150/287] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:50:19 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 28174 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:50:19.821197 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-8542d647-257c-44cc-8c0f-c1072365680b tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:19.828615 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-8542d647-257c-44cc-8c0f-c1072365680b tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1315 microversion: 2.1 time: 0.148245 Dec 16 15:50:19.829176 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 138/288] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:19 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:50:19.940746 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-5943b079-a4e3-4900-9db3-7be912474a8b tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:19.941457 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-5943b079-a4e3-4900-9db3-7be912474a8b tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:19.948167 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5943b079-a4e3-4900-9db3-7be912474a8b tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:19.948615 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5943b079-a4e3-4900-9db3-7be912474a8b tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:19.949384 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5943b079-a4e3-4900-9db3-7be912474a8b tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:19.949838 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5943b079-a4e3-4900-9db3-7be912474a8b tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:20.142323 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-5943b079-a4e3-4900-9db3-7be912474a8b tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:20.149873 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-5943b079-a4e3-4900-9db3-7be912474a8b tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.213180 Dec 16 15:50:20.150513 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 151/289] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:19 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:20.558781 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-ae6fa3a8-ceea-4288-9736-fc1e6c2b568a tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1f7f9de-3db5-42e5-b279-bb242347eec7"}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:20.559908 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-ae6fa3a8-ceea-4288-9736-fc1e6c2b568a tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:20.566305 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ae6fa3a8-ceea-4288-9736-fc1e6c2b568a tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:20.566727 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ae6fa3a8-ceea-4288-9736-fc1e6c2b568a tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:20.567489 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ae6fa3a8-ceea-4288-9736-fc1e6c2b568a tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:20.567941 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ae6fa3a8-ceea-4288-9736-fc1e6c2b568a tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:20.718996 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-1e913fe9-61c6-4c76-87a3-c71fe8d0d89d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:20.720116 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-1e913fe9-61c6-4c76-87a3-c71fe8d0d89d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:20.727538 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1e913fe9-61c6-4c76-87a3-c71fe8d0d89d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:20.728412 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1e913fe9-61c6-4c76-87a3-c71fe8d0d89d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:20.730165 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1e913fe9-61c6-4c76-87a3-c71fe8d0d89d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:20.730165 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1e913fe9-61c6-4c76-87a3-c71fe8d0d89d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:20.808073 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-1e913fe9-61c6-4c76-87a3-c71fe8d0d89d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 28174 microversion: 2.1 time: 0.093749 Dec 16 15:50:20.808715 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 152/290] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:50:20 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 28174 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:50:20.823573 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-ae6fa3a8-ceea-4288-9736-fc1e6c2b568a tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "POST /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268447 Dec 16 15:50:20.824504 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 139/291] 10.222.0.31 () {60 vars in 1322 bytes} [Thu Dec 16 15:50:20 2021] POST /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:50:20.845216 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-a77f80df-38f1-4b87-bcc2-16311c0e19a6 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:20.847009 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-a77f80df-38f1-4b87-bcc2-16311c0e19a6 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:20.854519 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a77f80df-38f1-4b87-bcc2-16311c0e19a6 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:20.855300 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a77f80df-38f1-4b87-bcc2-16311c0e19a6 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:20.856352 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a77f80df-38f1-4b87-bcc2-16311c0e19a6 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:20.857000 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a77f80df-38f1-4b87-bcc2-16311c0e19a6 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:21.000561 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-a77f80df-38f1-4b87-bcc2-16311c0e19a6 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:21.011225 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-a77f80df-38f1-4b87-bcc2-16311c0e19a6 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1315 microversion: 2.1 time: 0.170320 Dec 16 15:50:21.012133 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 153/292] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:20 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:21.170092 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-7d8cd9da-4276-44ee-8b70-aed00d025121 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:21.171237 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-7d8cd9da-4276-44ee-8b70-aed00d025121 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:21.182383 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7d8cd9da-4276-44ee-8b70-aed00d025121 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:21.182797 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7d8cd9da-4276-44ee-8b70-aed00d025121 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:21.185084 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7d8cd9da-4276-44ee-8b70-aed00d025121 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:21.185723 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7d8cd9da-4276-44ee-8b70-aed00d025121 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:21.332165 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-7d8cd9da-4276-44ee-8b70-aed00d025121 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:21.340561 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-7d8cd9da-4276-44ee-8b70-aed00d025121 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.175789 Dec 16 15:50:21.350406 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 140/293] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:21 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:21.819813 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-93477292-171a-4d6b-9ffe-55dfa08abd4e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:21.821183 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-93477292-171a-4d6b-9ffe-55dfa08abd4e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:21.829836 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-93477292-171a-4d6b-9ffe-55dfa08abd4e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:21.830606 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-93477292-171a-4d6b-9ffe-55dfa08abd4e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:21.832677 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-93477292-171a-4d6b-9ffe-55dfa08abd4e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:21.833371 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-93477292-171a-4d6b-9ffe-55dfa08abd4e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:21.932207 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-93477292-171a-4d6b-9ffe-55dfa08abd4e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 28174 microversion: 2.1 time: 0.115958 Dec 16 15:50:21.932784 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 154/294] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:50:21 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 28174 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:50:22.030705 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-b57487de-40a2-40c9-815f-e2f52078c36b tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:22.031556 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-b57487de-40a2-40c9-815f-e2f52078c36b tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:22.040966 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b57487de-40a2-40c9-815f-e2f52078c36b tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:22.041651 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b57487de-40a2-40c9-815f-e2f52078c36b tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:22.042864 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b57487de-40a2-40c9-815f-e2f52078c36b tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:22.043471 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b57487de-40a2-40c9-815f-e2f52078c36b tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:22.174054 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-b57487de-40a2-40c9-815f-e2f52078c36b tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:22.184804 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-b57487de-40a2-40c9-815f-e2f52078c36b tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1315 microversion: 2.1 time: 0.159119 Dec 16 15:50:22.185712 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 141/295] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:22 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:22.358462 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-3ea609ce-ce2e-4cdc-bd05-39d3881c03df tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:22.359251 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-3ea609ce-ce2e-4cdc-bd05-39d3881c03df tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:22.366495 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3ea609ce-ce2e-4cdc-bd05-39d3881c03df tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:22.366944 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3ea609ce-ce2e-4cdc-bd05-39d3881c03df tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:22.367775 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3ea609ce-ce2e-4cdc-bd05-39d3881c03df tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:22.368206 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3ea609ce-ce2e-4cdc-bd05-39d3881c03df tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:22.503225 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-3ea609ce-ce2e-4cdc-bd05-39d3881c03df tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:22.511143 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-3ea609ce-ce2e-4cdc-bd05-39d3881c03df tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.156829 Dec 16 15:50:22.512040 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 155/296] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:22 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:22.942863 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-b675fd4d-3999-4d4b-858d-ad32265dd3bf tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:22.944091 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-b675fd4d-3999-4d4b-858d-ad32265dd3bf tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:22.950445 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b675fd4d-3999-4d4b-858d-ad32265dd3bf tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:22.950894 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b675fd4d-3999-4d4b-858d-ad32265dd3bf tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:22.951675 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b675fd4d-3999-4d4b-858d-ad32265dd3bf tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:22.952169 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b675fd4d-3999-4d4b-858d-ad32265dd3bf tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:23.069346 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-b675fd4d-3999-4d4b-858d-ad32265dd3bf tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 28298 microversion: 2.1 time: 0.129911 Dec 16 15:50:23.070020 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 142/297] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:50:22 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 28298 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:50:23.203935 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-91bff0df-ccca-4ef8-9b8a-46e4e91ccba7 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:23.205136 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-91bff0df-ccca-4ef8-9b8a-46e4e91ccba7 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:23.216564 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-91bff0df-ccca-4ef8-9b8a-46e4e91ccba7 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:23.216564 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-91bff0df-ccca-4ef8-9b8a-46e4e91ccba7 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:23.216924 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-91bff0df-ccca-4ef8-9b8a-46e4e91ccba7 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:23.217828 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-91bff0df-ccca-4ef8-9b8a-46e4e91ccba7 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:23.359819 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-91bff0df-ccca-4ef8-9b8a-46e4e91ccba7 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:23.367661 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-91bff0df-ccca-4ef8-9b8a-46e4e91ccba7 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1315 microversion: 2.1 time: 0.167464 Dec 16 15:50:23.368223 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 156/298] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:23 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:23.528649 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-f236090a-c51d-4149-b20f-f6d3474361a3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:23.529347 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-f236090a-c51d-4149-b20f-f6d3474361a3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:23.536563 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f236090a-c51d-4149-b20f-f6d3474361a3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:23.537013 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f236090a-c51d-4149-b20f-f6d3474361a3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:23.537859 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f236090a-c51d-4149-b20f-f6d3474361a3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:23.538319 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f236090a-c51d-4149-b20f-f6d3474361a3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:23.669753 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-f236090a-c51d-4149-b20f-f6d3474361a3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:23.677919 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-f236090a-c51d-4149-b20f-f6d3474361a3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.153221 Dec 16 15:50:23.678456 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 143/299] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:23 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:24.080820 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ccdc54bc-926f-4ec5-a210-cfb3533610d1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:24.081761 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-ccdc54bc-926f-4ec5-a210-cfb3533610d1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:24.088143 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ccdc54bc-926f-4ec5-a210-cfb3533610d1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:24.088590 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ccdc54bc-926f-4ec5-a210-cfb3533610d1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:24.089664 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ccdc54bc-926f-4ec5-a210-cfb3533610d1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:24.090088 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ccdc54bc-926f-4ec5-a210-cfb3533610d1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:24.384388 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-c8259ac0-a2b5-4b20-8102-49852e6db8f2 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:24.385110 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-c8259ac0-a2b5-4b20-8102-49852e6db8f2 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:24.392114 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c8259ac0-a2b5-4b20-8102-49852e6db8f2 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:24.392649 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c8259ac0-a2b5-4b20-8102-49852e6db8f2 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:24.394314 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c8259ac0-a2b5-4b20-8102-49852e6db8f2 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:24.394746 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c8259ac0-a2b5-4b20-8102-49852e6db8f2 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:24.535330 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-c8259ac0-a2b5-4b20-8102-49852e6db8f2 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:24.548405 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-c8259ac0-a2b5-4b20-8102-49852e6db8f2 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1315 microversion: 2.1 time: 0.167794 Dec 16 15:50:24.549224 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 144/300] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:24 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:24.695780 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-a1ef2548-5e33-4472-a514-7527e5aa5c28 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:24.696387 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-a1ef2548-5e33-4472-a514-7527e5aa5c28 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:24.702857 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a1ef2548-5e33-4472-a514-7527e5aa5c28 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:24.703286 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a1ef2548-5e33-4472-a514-7527e5aa5c28 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:24.704053 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a1ef2548-5e33-4472-a514-7527e5aa5c28 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:24.704481 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a1ef2548-5e33-4472-a514-7527e5aa5c28 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:24.838369 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-a1ef2548-5e33-4472-a514-7527e5aa5c28 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:24.846365 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-a1ef2548-5e33-4472-a514-7527e5aa5c28 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.154193 Dec 16 15:50:24.846894 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 145/301] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:24 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:25.570074 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-ee50ea5f-b446-42b1-80e7-ed62c7a52ce5 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:25.570074 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-ee50ea5f-b446-42b1-80e7-ed62c7a52ce5 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:25.575113 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ee50ea5f-b446-42b1-80e7-ed62c7a52ce5 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:25.575562 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ee50ea5f-b446-42b1-80e7-ed62c7a52ce5 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:25.576345 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ee50ea5f-b446-42b1-80e7-ed62c7a52ce5 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:25.576770 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ee50ea5f-b446-42b1-80e7-ed62c7a52ce5 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:25.726759 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-ee50ea5f-b446-42b1-80e7-ed62c7a52ce5 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:25.734182 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-ee50ea5f-b446-42b1-80e7-ed62c7a52ce5 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1315 microversion: 2.1 time: 0.172626 Dec 16 15:50:25.734739 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 146/302] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:25 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:50:25.867429 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-5f366012-06c9-4211-9624-0ca77766f8ac tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:25.868414 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-5f366012-06c9-4211-9624-0ca77766f8ac tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:25.877198 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5f366012-06c9-4211-9624-0ca77766f8ac tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:25.877675 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5f366012-06c9-4211-9624-0ca77766f8ac tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:25.878434 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5f366012-06c9-4211-9624-0ca77766f8ac tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:25.878836 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5f366012-06c9-4211-9624-0ca77766f8ac tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:26.010429 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-5f366012-06c9-4211-9624-0ca77766f8ac tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:26.020022 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-5f366012-06c9-4211-9624-0ca77766f8ac tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.158598 Dec 16 15:50:26.020677 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 147/303] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:25 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:26.378545 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-ccdc54bc-926f-4ec5-a210-cfb3533610d1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 28463 microversion: 2.1 time: 2.301078 Dec 16 15:50:26.379435 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 157/304] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:50:24 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 28463 bytes in 2303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:50:26.754660 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-832fc8b5-fb79-4dcd-97f9-758933aff503 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:26.755674 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-832fc8b5-fb79-4dcd-97f9-758933aff503 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:26.766288 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-832fc8b5-fb79-4dcd-97f9-758933aff503 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:26.766981 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-832fc8b5-fb79-4dcd-97f9-758933aff503 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:26.769440 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-832fc8b5-fb79-4dcd-97f9-758933aff503 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:26.770713 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-832fc8b5-fb79-4dcd-97f9-758933aff503 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:26.926651 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-832fc8b5-fb79-4dcd-97f9-758933aff503 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:26.937459 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-832fc8b5-fb79-4dcd-97f9-758933aff503 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1315 microversion: 2.1 time: 0.188714 Dec 16 15:50:26.938174 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 148/305] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:26 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:27.041312 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-4a1a301e-b79f-4fa5-921e-c20af6a37c32 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:27.042314 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-4a1a301e-b79f-4fa5-921e-c20af6a37c32 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:27.050649 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4a1a301e-b79f-4fa5-921e-c20af6a37c32 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:27.051122 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4a1a301e-b79f-4fa5-921e-c20af6a37c32 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:27.051917 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4a1a301e-b79f-4fa5-921e-c20af6a37c32 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:27.052352 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4a1a301e-b79f-4fa5-921e-c20af6a37c32 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:27.198112 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-4a1a301e-b79f-4fa5-921e-c20af6a37c32 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:27.205669 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-4a1a301e-b79f-4fa5-921e-c20af6a37c32 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.169090 Dec 16 15:50:27.206236 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 158/306] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:27 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:27.389987 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-4350dbc0-e726-49e5-8e94-f0a77acf3483 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:27.391066 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-4350dbc0-e726-49e5-8e94-f0a77acf3483 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:27.397346 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4350dbc0-e726-49e5-8e94-f0a77acf3483 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:27.397958 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4350dbc0-e726-49e5-8e94-f0a77acf3483 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:27.398810 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4350dbc0-e726-49e5-8e94-f0a77acf3483 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:27.399353 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4350dbc0-e726-49e5-8e94-f0a77acf3483 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:27.963394 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-152d1fe9-1c79-40f4-b01c-f49284d04e61 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:27.964642 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-152d1fe9-1c79-40f4-b01c-f49284d04e61 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:27.975501 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-152d1fe9-1c79-40f4-b01c-f49284d04e61 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:27.976601 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-152d1fe9-1c79-40f4-b01c-f49284d04e61 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:27.977956 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-152d1fe9-1c79-40f4-b01c-f49284d04e61 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:27.978680 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-152d1fe9-1c79-40f4-b01c-f49284d04e61 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:28.113939 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-152d1fe9-1c79-40f4-b01c-f49284d04e61 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:28.121429 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-152d1fe9-1c79-40f4-b01c-f49284d04e61 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1315 microversion: 2.1 time: 0.164951 Dec 16 15:50:28.121964 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 159/307] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:27 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:28.227002 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-03f550a1-e5bd-4b4f-b594-b74b5e0557cf tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:28.227900 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-03f550a1-e5bd-4b4f-b594-b74b5e0557cf tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:28.238334 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-03f550a1-e5bd-4b4f-b594-b74b5e0557cf tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:28.239075 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-03f550a1-e5bd-4b4f-b594-b74b5e0557cf tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:28.240418 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-03f550a1-e5bd-4b4f-b594-b74b5e0557cf tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:28.241101 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-03f550a1-e5bd-4b4f-b594-b74b5e0557cf tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:28.384472 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-03f550a1-e5bd-4b4f-b594-b74b5e0557cf tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:28.392340 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-03f550a1-e5bd-4b4f-b594-b74b5e0557cf tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.172099 Dec 16 15:50:28.401311 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 160/308] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:28 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:29.138724 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-816b3781-04d0-4fc4-b229-4859bcf26b4d tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:29.139736 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-816b3781-04d0-4fc4-b229-4859bcf26b4d tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:29.146064 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-816b3781-04d0-4fc4-b229-4859bcf26b4d tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:29.146508 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-816b3781-04d0-4fc4-b229-4859bcf26b4d tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:29.147494 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-816b3781-04d0-4fc4-b229-4859bcf26b4d tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:29.147718 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-816b3781-04d0-4fc4-b229-4859bcf26b4d tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:29.291046 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-816b3781-04d0-4fc4-b229-4859bcf26b4d tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:29.298781 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-816b3781-04d0-4fc4-b229-4859bcf26b4d tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1315 microversion: 2.1 time: 0.163685 Dec 16 15:50:29.299338 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 161/309] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:29 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:29.414629 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-0cbeb5dc-038b-4b1f-96c7-6560eeac50ba tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:29.415565 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-0cbeb5dc-038b-4b1f-96c7-6560eeac50ba tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:29.424305 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0cbeb5dc-038b-4b1f-96c7-6560eeac50ba tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:29.424754 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0cbeb5dc-038b-4b1f-96c7-6560eeac50ba tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:29.425563 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0cbeb5dc-038b-4b1f-96c7-6560eeac50ba tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:29.425993 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0cbeb5dc-038b-4b1f-96c7-6560eeac50ba tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:29.562829 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-0cbeb5dc-038b-4b1f-96c7-6560eeac50ba tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:29.571099 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-0cbeb5dc-038b-4b1f-96c7-6560eeac50ba tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.163558 Dec 16 15:50:29.571656 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 162/310] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:29 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:30.315116 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-4350dbc0-e726-49e5-8e94-f0a77acf3483 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 28748 microversion: 2.1 time: 2.928454 Dec 16 15:50:30.315780 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 149/311] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:50:27 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 28748 bytes in 2930 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:50:30.317930 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-e60c96c5-d3cd-46d5-adbf-eeb43c6cf134 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:30.319089 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-e60c96c5-d3cd-46d5-adbf-eeb43c6cf134 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:30.326286 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e60c96c5-d3cd-46d5-adbf-eeb43c6cf134 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:30.327004 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e60c96c5-d3cd-46d5-adbf-eeb43c6cf134 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:30.327791 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e60c96c5-d3cd-46d5-adbf-eeb43c6cf134 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:30.328216 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e60c96c5-d3cd-46d5-adbf-eeb43c6cf134 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:30.464870 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-e60c96c5-d3cd-46d5-adbf-eeb43c6cf134 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:30.472724 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-e60c96c5-d3cd-46d5-adbf-eeb43c6cf134 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1315 microversion: 2.1 time: 0.160159 Dec 16 15:50:30.473436 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 163/312] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:30 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:50:30.591115 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-509744f2-d434-4015-982f-e99ac0870931 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:30.592060 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-509744f2-d434-4015-982f-e99ac0870931 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:30.599781 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-509744f2-d434-4015-982f-e99ac0870931 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:30.600220 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-509744f2-d434-4015-982f-e99ac0870931 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:30.601326 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-509744f2-d434-4015-982f-e99ac0870931 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:30.601781 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-509744f2-d434-4015-982f-e99ac0870931 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:30.744840 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-509744f2-d434-4015-982f-e99ac0870931 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:30.753902 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-509744f2-d434-4015-982f-e99ac0870931 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.168656 Dec 16 15:50:30.754438 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 150/313] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:30 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:30.820551 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-16556094-ed30-49b2-aa72-b3a333b27bd5 req-1132edb1-9d49-4dcc-8b84-50886c99f2b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57099c29-992b-4d24-9ce5-251ac704d335", "name": "network-vif-plugged", "status": "completed", "tag": "07e7c44a-e6c2-471c-93ac-f346f0ad0d93"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:30.821610 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:50:30.821610 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:50:30.829346 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-16556094-ed30-49b2-aa72-b3a333b27bd5 req-1132edb1-9d49-4dcc-8b84-50886c99f2b6 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:30.829831 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-16556094-ed30-49b2-aa72-b3a333b27bd5 req-1132edb1-9d49-4dcc-8b84-50886c99f2b6 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:30.841257 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-16556094-ed30-49b2-aa72-b3a333b27bd5 req-1132edb1-9d49-4dcc-8b84-50886c99f2b6 service nova] Creating event network-vif-plugged:07e7c44a-e6c2-471c-93ac-f346f0ad0d93 for instance 57099c29-992b-4d24-9ce5-251ac704d335 on hv-cinder-78447 Dec 16 15:50:30.846982 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-16556094-ed30-49b2-aa72-b3a333b27bd5 req-1132edb1-9d49-4dcc-8b84-50886c99f2b6 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033373 Dec 16 15:50:30.846982 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 164/314] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:50:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:50:31.331228 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-e995d8aa-fd22-4401-b23d-645c2f2e53ac tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:31.332583 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-e995d8aa-fd22-4401-b23d-645c2f2e53ac tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:31.343252 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e995d8aa-fd22-4401-b23d-645c2f2e53ac tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:31.344000 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e995d8aa-fd22-4401-b23d-645c2f2e53ac tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:31.345125 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e995d8aa-fd22-4401-b23d-645c2f2e53ac tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:31.345590 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e995d8aa-fd22-4401-b23d-645c2f2e53ac tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:31.491894 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-9973c128-d716-4af7-bbf9-33aac2bf1e3c tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:31.492580 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-9973c128-d716-4af7-bbf9-33aac2bf1e3c tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:31.499389 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9973c128-d716-4af7-bbf9-33aac2bf1e3c tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:31.499835 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9973c128-d716-4af7-bbf9-33aac2bf1e3c tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:31.500639 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9973c128-d716-4af7-bbf9-33aac2bf1e3c tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:31.501070 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9973c128-d716-4af7-bbf9-33aac2bf1e3c tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:31.640690 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-9973c128-d716-4af7-bbf9-33aac2bf1e3c tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:31.648468 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-9973c128-d716-4af7-bbf9-33aac2bf1e3c tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1315 microversion: 2.1 time: 0.161068 Dec 16 15:50:31.649029 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 165/315] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:31 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:31.775077 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-dbc61d45-d3a9-4f20-b7e1-91202a51ac72 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:31.776146 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-dbc61d45-d3a9-4f20-b7e1-91202a51ac72 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:31.785999 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-dbc61d45-d3a9-4f20-b7e1-91202a51ac72 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:31.786449 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-dbc61d45-d3a9-4f20-b7e1-91202a51ac72 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:31.787254 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-dbc61d45-d3a9-4f20-b7e1-91202a51ac72 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:31.787683 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-dbc61d45-d3a9-4f20-b7e1-91202a51ac72 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:31.926974 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-dbc61d45-d3a9-4f20-b7e1-91202a51ac72 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:31.934607 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-dbc61d45-d3a9-4f20-b7e1-91202a51ac72 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.165936 Dec 16 15:50:31.935186 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 166/316] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:31 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:32.665272 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-f3232ce5-d45f-4623-9fa5-b7df80a29752 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:32.665905 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-f3232ce5-d45f-4623-9fa5-b7df80a29752 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:32.672586 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f3232ce5-d45f-4623-9fa5-b7df80a29752 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:32.673037 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f3232ce5-d45f-4623-9fa5-b7df80a29752 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:32.673896 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f3232ce5-d45f-4623-9fa5-b7df80a29752 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:32.674331 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f3232ce5-d45f-4623-9fa5-b7df80a29752 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:32.812450 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-f3232ce5-d45f-4623-9fa5-b7df80a29752 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:32.820774 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-f3232ce5-d45f-4623-9fa5-b7df80a29752 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1315 microversion: 2.1 time: 0.159158 Dec 16 15:50:32.821377 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 167/317] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:32 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:32.952165 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-b7becb99-c4d7-4b1a-a267-4801cae0d913 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:32.952791 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-b7becb99-c4d7-4b1a-a267-4801cae0d913 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:32.959959 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b7becb99-c4d7-4b1a-a267-4801cae0d913 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:32.960407 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b7becb99-c4d7-4b1a-a267-4801cae0d913 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:32.961202 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b7becb99-c4d7-4b1a-a267-4801cae0d913 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:32.961677 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b7becb99-c4d7-4b1a-a267-4801cae0d913 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:33.099070 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-b7becb99-c4d7-4b1a-a267-4801cae0d913 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:33.106964 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-b7becb99-c4d7-4b1a-a267-4801cae0d913 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.159391 Dec 16 15:50:33.107536 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 168/318] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:32 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:33.838214 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-9343df4b-33bf-4444-aee7-1468f0445055 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:33.838912 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-9343df4b-33bf-4444-aee7-1468f0445055 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:33.845955 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9343df4b-33bf-4444-aee7-1468f0445055 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:33.846411 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9343df4b-33bf-4444-aee7-1468f0445055 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:33.847205 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9343df4b-33bf-4444-aee7-1468f0445055 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:33.847636 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9343df4b-33bf-4444-aee7-1468f0445055 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:33.985616 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-9343df4b-33bf-4444-aee7-1468f0445055 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:33.993628 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-9343df4b-33bf-4444-aee7-1468f0445055 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1315 microversion: 2.1 time: 0.159085 Dec 16 15:50:33.994198 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 169/319] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:33 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:34.125074 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-cbe3e528-0ef1-48e6-afa3-8c2ff6271b34 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:34.125725 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-cbe3e528-0ef1-48e6-afa3-8c2ff6271b34 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:34.132386 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-cbe3e528-0ef1-48e6-afa3-8c2ff6271b34 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:34.132832 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-cbe3e528-0ef1-48e6-afa3-8c2ff6271b34 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:34.133649 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-cbe3e528-0ef1-48e6-afa3-8c2ff6271b34 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:34.134081 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-cbe3e528-0ef1-48e6-afa3-8c2ff6271b34 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:34.279172 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-cbe3e528-0ef1-48e6-afa3-8c2ff6271b34 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:34.288408 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-cbe3e528-0ef1-48e6-afa3-8c2ff6271b34 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.167060 Dec 16 15:50:34.288969 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 170/320] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:34 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:34.486985 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-e995d8aa-fd22-4401-b23d-645c2f2e53ac tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 28918 microversion: 2.1 time: 3.161897 Dec 16 15:50:34.487591 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 151/321] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:50:31 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 28918 bytes in 3164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:50:34.819310 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-55510cfc-835f-47be-98e0-5b1e0c5180a9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1f7f9de-3db5-42e5-b279-bb242347eec7"}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:34.820408 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-55510cfc-835f-47be-98e0-5b1e0c5180a9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:34.826384 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-55510cfc-835f-47be-98e0-5b1e0c5180a9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:34.826831 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-55510cfc-835f-47be-98e0-5b1e0c5180a9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:34.827599 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-55510cfc-835f-47be-98e0-5b1e0c5180a9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:34.828024 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-55510cfc-835f-47be-98e0-5b1e0c5180a9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:34.911056 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.wsgi [None req-55510cfc-835f-47be-98e0-5b1e0c5180a9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] HTTP exception thrown: Invalid volume: volume c1f7f9de-3db5-42e5-b279-bb242347eec7 is already attached to instances: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4 Dec 16 15:50:34.911701 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-55510cfc-835f-47be-98e0-5b1e0c5180a9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Returning 400 to user: Invalid volume: volume c1f7f9de-3db5-42e5-b279-bb242347eec7 is already attached to instances: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4 {{(pid=122399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:50:34.912469 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-55510cfc-835f-47be-98e0-5b1e0c5180a9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "POST /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097635 Dec 16 15:50:34.912992 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 171/322] 10.222.0.31 () {60 vars in 1322 bytes} [Thu Dec 16 15:50:34 2021] POST /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 16 15:50:34.975640 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-d892664f-cb35-40d4-8618-bf6a9cb7fc28 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:34.976629 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-d892664f-cb35-40d4-8618-bf6a9cb7fc28 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:34.984036 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d892664f-cb35-40d4-8618-bf6a9cb7fc28 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:34.984481 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d892664f-cb35-40d4-8618-bf6a9cb7fc28 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:34.985278 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d892664f-cb35-40d4-8618-bf6a9cb7fc28 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:34.985737 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d892664f-cb35-40d4-8618-bf6a9cb7fc28 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:35.015592 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-db3fd7f5-d1b4-48a2-bf00-90a0f28629a1 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:35.017645 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-db3fd7f5-d1b4-48a2-bf00-90a0f28629a1 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:35.026268 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-db3fd7f5-d1b4-48a2-bf00-90a0f28629a1 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:35.026859 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-db3fd7f5-d1b4-48a2-bf00-90a0f28629a1 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:35.028105 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-db3fd7f5-d1b4-48a2-bf00-90a0f28629a1 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:35.028691 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-db3fd7f5-d1b4-48a2-bf00-90a0f28629a1 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:35.076774 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.objects.instance [None req-d892664f-cb35-40d4-8618-bf6a9cb7fc28 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lazy-loading 'services' on Instance uuid 4f1cffca-44cf-40b7-9216-7d78fdbef5b4 {{(pid=122398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:50:35.150578 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-d892664f-cb35-40d4-8618-bf6a9cb7fc28 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "DELETE /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4/os-volume_attachments/c1f7f9de-3db5-42e5-b279-bb242347eec7" status: 202 len: 0 microversion: 2.1 time: 0.179203 Dec 16 15:50:35.151229 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 152/323] 10.222.0.31 () {58 vars in 1415 bytes} [Thu Dec 16 15:50:34 2021] DELETE /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4/os-volume_attachments/c1f7f9de-3db5-42e5-b279-bb242347eec7 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:50:35.160201 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-2baf867d-5cbf-4772-ad2a-bce12d1b8a2c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:35.161288 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-2baf867d-5cbf-4772-ad2a-bce12d1b8a2c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:35.163064 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-db3fd7f5-d1b4-48a2-bf00-90a0f28629a1 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:35.168226 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2baf867d-5cbf-4772-ad2a-bce12d1b8a2c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:35.168680 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2baf867d-5cbf-4772-ad2a-bce12d1b8a2c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:35.169606 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2baf867d-5cbf-4772-ad2a-bce12d1b8a2c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:35.170102 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2baf867d-5cbf-4772-ad2a-bce12d1b8a2c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:35.177779 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-db3fd7f5-d1b4-48a2-bf00-90a0f28629a1 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1315 microversion: 2.1 time: 0.167217 Dec 16 15:50:35.195313 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 172/324] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:35 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:35.208455 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-2baf867d-5cbf-4772-ad2a-bce12d1b8a2c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052510 Dec 16 15:50:35.209004 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 153/325] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Dec 16 15:50:35 2021] GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:50:35.305253 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-94c3d03d-6447-47d2-8392-d7d0f6820436 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:35.305924 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-94c3d03d-6447-47d2-8392-d7d0f6820436 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:35.311847 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-94c3d03d-6447-47d2-8392-d7d0f6820436 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:35.312314 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-94c3d03d-6447-47d2-8392-d7d0f6820436 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:35.313060 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-94c3d03d-6447-47d2-8392-d7d0f6820436 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:35.313522 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-94c3d03d-6447-47d2-8392-d7d0f6820436 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:35.452605 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-94c3d03d-6447-47d2-8392-d7d0f6820436 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:35.460305 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-94c3d03d-6447-47d2-8392-d7d0f6820436 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.158798 Dec 16 15:50:35.460859 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 173/326] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:35 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:35.498946 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-c999fa6c-c697-4b0c-970a-f4627da3e60e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:35.499857 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-c999fa6c-c697-4b0c-970a-f4627da3e60e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:35.506616 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c999fa6c-c697-4b0c-970a-f4627da3e60e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:35.507073 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c999fa6c-c697-4b0c-970a-f4627da3e60e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:35.507850 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c999fa6c-c697-4b0c-970a-f4627da3e60e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:35.508277 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c999fa6c-c697-4b0c-970a-f4627da3e60e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:36.201963 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-530e0225-f2a1-4265-977c-5668c3617c81 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:36.202585 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-530e0225-f2a1-4265-977c-5668c3617c81 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:36.209337 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-530e0225-f2a1-4265-977c-5668c3617c81 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:36.209908 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-530e0225-f2a1-4265-977c-5668c3617c81 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:36.210798 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-530e0225-f2a1-4265-977c-5668c3617c81 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:36.211135 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-530e0225-f2a1-4265-977c-5668c3617c81 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:36.349538 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-530e0225-f2a1-4265-977c-5668c3617c81 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:36.358896 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-530e0225-f2a1-4265-977c-5668c3617c81 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1315 microversion: 2.1 time: 0.160620 Dec 16 15:50:36.359482 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 174/327] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:36 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:36.363907 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-e3edeb8c-176a-46a5-ac4d-a2ed03d99031 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:36.364858 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-e3edeb8c-176a-46a5-ac4d-a2ed03d99031 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:36.370913 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e3edeb8c-176a-46a5-ac4d-a2ed03d99031 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:36.371353 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e3edeb8c-176a-46a5-ac4d-a2ed03d99031 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:36.372125 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e3edeb8c-176a-46a5-ac4d-a2ed03d99031 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:36.372551 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e3edeb8c-176a-46a5-ac4d-a2ed03d99031 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:36.402239 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-e3edeb8c-176a-46a5-ac4d-a2ed03d99031 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041629 Dec 16 15:50:36.402739 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 175/328] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Dec 16 15:50:36 2021] GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:50:36.477112 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-efbd13ba-067b-4929-b56e-2021b1f3fdea tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:36.477770 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-efbd13ba-067b-4929-b56e-2021b1f3fdea tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:36.483910 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-efbd13ba-067b-4929-b56e-2021b1f3fdea tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:36.484355 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-efbd13ba-067b-4929-b56e-2021b1f3fdea tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:36.485133 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-efbd13ba-067b-4929-b56e-2021b1f3fdea tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:36.485592 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-efbd13ba-067b-4929-b56e-2021b1f3fdea tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:36.622672 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-efbd13ba-067b-4929-b56e-2021b1f3fdea tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:36.630400 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-efbd13ba-067b-4929-b56e-2021b1f3fdea tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.157186 Dec 16 15:50:36.630946 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 176/329] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:36 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:50:37.376349 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-1df180d3-a674-461f-aa56-262cdd6229b1 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:37.377106 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-1df180d3-a674-461f-aa56-262cdd6229b1 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:37.384390 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1df180d3-a674-461f-aa56-262cdd6229b1 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:37.384886 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1df180d3-a674-461f-aa56-262cdd6229b1 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:37.385813 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1df180d3-a674-461f-aa56-262cdd6229b1 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:37.386293 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1df180d3-a674-461f-aa56-262cdd6229b1 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:37.527308 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-1df180d3-a674-461f-aa56-262cdd6229b1 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:37.534753 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-1df180d3-a674-461f-aa56-262cdd6229b1 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1315 microversion: 2.1 time: 0.162666 Dec 16 15:50:37.535273 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 177/330] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:37 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:37.539609 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-fbf0aa13-9fa8-4131-b496-c2a0b3cd1859 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:37.540505 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-fbf0aa13-9fa8-4131-b496-c2a0b3cd1859 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:37.546000 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-fbf0aa13-9fa8-4131-b496-c2a0b3cd1859 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:37.546437 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-fbf0aa13-9fa8-4131-b496-c2a0b3cd1859 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:37.547213 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-fbf0aa13-9fa8-4131-b496-c2a0b3cd1859 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:37.547637 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-fbf0aa13-9fa8-4131-b496-c2a0b3cd1859 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:37.578063 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-fbf0aa13-9fa8-4131-b496-c2a0b3cd1859 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041472 Dec 16 15:50:37.579060 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 178/331] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Dec 16 15:50:37 2021] GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:50:37.650632 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-c54335b0-db1d-4764-b43b-49bf45ccbb26 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:37.651577 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-c54335b0-db1d-4764-b43b-49bf45ccbb26 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:37.661063 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c54335b0-db1d-4764-b43b-49bf45ccbb26 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:37.661806 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c54335b0-db1d-4764-b43b-49bf45ccbb26 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:37.662999 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c54335b0-db1d-4764-b43b-49bf45ccbb26 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:37.663859 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c54335b0-db1d-4764-b43b-49bf45ccbb26 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:37.799161 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-c54335b0-db1d-4764-b43b-49bf45ccbb26 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:37.808054 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-c54335b0-db1d-4764-b43b-49bf45ccbb26 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.162874 Dec 16 15:50:37.808884 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 179/332] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:37 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:38.550529 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-092a7161-f57a-45e7-8cf6-397fe5fa586b tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:38.551125 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-092a7161-f57a-45e7-8cf6-397fe5fa586b tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:38.557605 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-092a7161-f57a-45e7-8cf6-397fe5fa586b tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:38.558046 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-092a7161-f57a-45e7-8cf6-397fe5fa586b tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:38.558810 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-092a7161-f57a-45e7-8cf6-397fe5fa586b tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:38.559238 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-092a7161-f57a-45e7-8cf6-397fe5fa586b tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:38.696067 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-092a7161-f57a-45e7-8cf6-397fe5fa586b tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:38.703433 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-092a7161-f57a-45e7-8cf6-397fe5fa586b tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1315 microversion: 2.1 time: 0.156688 Dec 16 15:50:38.703993 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 180/333] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:38 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:38.708693 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-b530ce5a-aeff-42d2-9f66-64ed03240da5 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:38.709635 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-b530ce5a-aeff-42d2-9f66-64ed03240da5 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:38.717260 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b530ce5a-aeff-42d2-9f66-64ed03240da5 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:38.718118 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b530ce5a-aeff-42d2-9f66-64ed03240da5 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:38.719361 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b530ce5a-aeff-42d2-9f66-64ed03240da5 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:38.719995 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b530ce5a-aeff-42d2-9f66-64ed03240da5 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:38.751739 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-b530ce5a-aeff-42d2-9f66-64ed03240da5 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046519 Dec 16 15:50:38.752306 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 181/334] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Dec 16 15:50:38 2021] GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:50:38.826753 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-5d9ad2b8-de0c-4669-98ba-575053dc836f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:38.827358 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-5d9ad2b8-de0c-4669-98ba-575053dc836f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:38.833776 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5d9ad2b8-de0c-4669-98ba-575053dc836f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:38.834223 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5d9ad2b8-de0c-4669-98ba-575053dc836f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:38.834985 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5d9ad2b8-de0c-4669-98ba-575053dc836f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:38.835400 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5d9ad2b8-de0c-4669-98ba-575053dc836f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:38.857440 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-c999fa6c-c697-4b0c-970a-f4627da3e60e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 28918 microversion: 2.1 time: 3.361905 Dec 16 15:50:38.858731 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 154/335] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:50:35 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 28918 bytes in 3364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:50:38.971303 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-5d9ad2b8-de0c-4669-98ba-575053dc836f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:38.981832 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-5d9ad2b8-de0c-4669-98ba-575053dc836f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.158703 Dec 16 15:50:38.982403 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 182/336] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:38 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:39.720846 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-778b16ef-6198-4fba-ac5f-40e7e2939303 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:39.721625 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-778b16ef-6198-4fba-ac5f-40e7e2939303 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:39.728849 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-778b16ef-6198-4fba-ac5f-40e7e2939303 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:39.729350 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-778b16ef-6198-4fba-ac5f-40e7e2939303 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:39.730373 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-778b16ef-6198-4fba-ac5f-40e7e2939303 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:39.730809 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-778b16ef-6198-4fba-ac5f-40e7e2939303 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:39.762990 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-3e471a78-7b6c-42b9-b2e0-910cd5c95f92 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:39.763792 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-3e471a78-7b6c-42b9-b2e0-910cd5c95f92 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:39.770608 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3e471a78-7b6c-42b9-b2e0-910cd5c95f92 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:39.771051 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3e471a78-7b6c-42b9-b2e0-910cd5c95f92 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:39.771851 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3e471a78-7b6c-42b9-b2e0-910cd5c95f92 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:39.772271 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3e471a78-7b6c-42b9-b2e0-910cd5c95f92 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:39.802652 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-3e471a78-7b6c-42b9-b2e0-910cd5c95f92 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043437 Dec 16 15:50:39.803205 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 183/337] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Dec 16 15:50:39 2021] GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:50:39.864263 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-778b16ef-6198-4fba-ac5f-40e7e2939303 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:39.869675 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-36c27d58-edbd-486c-bfb8-b5a4258de012 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:39.870583 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-36c27d58-edbd-486c-bfb8-b5a4258de012 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:39.872018 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-778b16ef-6198-4fba-ac5f-40e7e2939303 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1465 microversion: 2.1 time: 0.155454 Dec 16 15:50:39.872587 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 155/338] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:39 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1465 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:39.877193 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-36c27d58-edbd-486c-bfb8-b5a4258de012 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:39.877687 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-36c27d58-edbd-486c-bfb8-b5a4258de012 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:39.878577 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-36c27d58-edbd-486c-bfb8-b5a4258de012 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:39.878978 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-36c27d58-edbd-486c-bfb8-b5a4258de012 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:39.911872 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-bc5da621-25c1-4c13-9711-06fd9d1e2936 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:39.912365 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-bc5da621-25c1-4c13-9711-06fd9d1e2936 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:39.918474 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-bc5da621-25c1-4c13-9711-06fd9d1e2936 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:39.918894 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-bc5da621-25c1-4c13-9711-06fd9d1e2936 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:39.919693 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-bc5da621-25c1-4c13-9711-06fd9d1e2936 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:39.920098 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-bc5da621-25c1-4c13-9711-06fd9d1e2936 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:39.945725 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-bc5da621-25c1-4c13-9711-06fd9d1e2936 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Going to try to terminate instance {{(pid=122398) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 15:50:39.977775 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-36c27d58-edbd-486c-bfb8-b5a4258de012 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 28918 microversion: 2.1 time: 0.111842 Dec 16 15:50:39.980179 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 184/339] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:50:39 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 28918 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:50:40.004746 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-df2d2df8-2ed8-4188-a50f-975fc7f19ab3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:40.006345 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-df2d2df8-2ed8-4188-a50f-975fc7f19ab3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:40.037690 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-df2d2df8-2ed8-4188-a50f-975fc7f19ab3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:40.038289 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-df2d2df8-2ed8-4188-a50f-975fc7f19ab3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:40.040406 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-df2d2df8-2ed8-4188-a50f-975fc7f19ab3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:40.042178 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-df2d2df8-2ed8-4188-a50f-975fc7f19ab3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:40.055434 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-bc5da621-25c1-4c13-9711-06fd9d1e2936 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "DELETE /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 204 len: 0 microversion: 2.1 time: 0.146819 Dec 16 15:50:40.056359 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 156/340] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Dec 16 15:50:39 2021] DELETE /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 16 15:50:40.066656 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-f2b0dd79-32a2-4dfb-9ccc-376436fa5e05 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:40.067361 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-f2b0dd79-32a2-4dfb-9ccc-376436fa5e05 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:40.074633 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f2b0dd79-32a2-4dfb-9ccc-376436fa5e05 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:40.074633 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f2b0dd79-32a2-4dfb-9ccc-376436fa5e05 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:40.075364 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f2b0dd79-32a2-4dfb-9ccc-376436fa5e05 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:40.075804 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f2b0dd79-32a2-4dfb-9ccc-376436fa5e05 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:40.285479 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-df2d2df8-2ed8-4188-a50f-975fc7f19ab3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:40.293141 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-f2b0dd79-32a2-4dfb-9ccc-376436fa5e05 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:40.299884 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-df2d2df8-2ed8-4188-a50f-975fc7f19ab3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.303690 Dec 16 15:50:40.300454 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 185/341] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:39 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:50:40.305332 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-f2b0dd79-32a2-4dfb-9ccc-376436fa5e05 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1471 microversion: 2.1 time: 0.244496 Dec 16 15:50:40.305992 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 157/342] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:40 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1471 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:50:40.813806 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ef6e1380-51d6-4c06-9fcc-6a0e6295b26a tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:40.814769 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-ef6e1380-51d6-4c06-9fcc-6a0e6295b26a tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:40.821305 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ef6e1380-51d6-4c06-9fcc-6a0e6295b26a tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:40.821879 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ef6e1380-51d6-4c06-9fcc-6a0e6295b26a tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:40.822567 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ef6e1380-51d6-4c06-9fcc-6a0e6295b26a tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:40.822995 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ef6e1380-51d6-4c06-9fcc-6a0e6295b26a tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:40.853728 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-ef6e1380-51d6-4c06-9fcc-6a0e6295b26a tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043648 Dec 16 15:50:40.854411 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 186/343] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Dec 16 15:50:40 2021] GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:50:40.989849 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-a6164158-5090-4703-9368-cf92b3cd6257 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:40.991770 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-a6164158-5090-4703-9368-cf92b3cd6257 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:40.999692 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a6164158-5090-4703-9368-cf92b3cd6257 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:41.000123 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a6164158-5090-4703-9368-cf92b3cd6257 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:41.000913 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a6164158-5090-4703-9368-cf92b3cd6257 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:41.001359 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a6164158-5090-4703-9368-cf92b3cd6257 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:41.012517 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-95f7fb9d-7505-44e5-bcbb-abf701906c8c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1040829030", "imageRef": "2a1434ad-0c2c-4725-baad-a605624baf01", "flavorRef": "452", "networks": [{"uuid": "4e96172c-0b71-4de2-95ab-4226e7a02984"}]}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:41.062997 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.network.neutron [None req-95f7fb9d-7505-44e5-bcbb-abf701906c8c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] validate_networks() for [('4e96172c-0b71-4de2-95ab-4226e7a02984', None, None, None, None, None)] {{(pid=122399) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 15:50:41.445512 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-95f7fb9d-7505-44e5-bcbb-abf701906c8c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Flavor limits 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 15:50:41.446115 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-95f7fb9d-7505-44e5-bcbb-abf701906c8c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Image limits 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 15:50:41.446812 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-95f7fb9d-7505-44e5-bcbb-abf701906c8c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Flavor pref 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 15:50:41.447397 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-95f7fb9d-7505-44e5-bcbb-abf701906c8c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Image pref 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 15:50:41.447974 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-95f7fb9d-7505-44e5-bcbb-abf701906c8c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 15:50:41.459550 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-95f7fb9d-7505-44e5-bcbb-abf701906c8c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:41.459989 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-95f7fb9d-7505-44e5-bcbb-abf701906c8c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:41.460790 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-95f7fb9d-7505-44e5-bcbb-abf701906c8c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:41.461212 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-95f7fb9d-7505-44e5-bcbb-abf701906c8c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:41.477334 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-95f7fb9d-7505-44e5-bcbb-abf701906c8c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Getting quotas for project 44bf2643f52c4cc5aa01ae68ef13e12f. Resources: {'instances', 'ram', 'cores'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:50:41.481536 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-95f7fb9d-7505-44e5-bcbb-abf701906c8c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Getting quotas for user 9b1c255006524ad9b700c0711ecbd569 and project 44bf2643f52c4cc5aa01ae68ef13e12f. Resources: {'instances', 'ram', 'cores'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:50:41.492813 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-95f7fb9d-7505-44e5-bcbb-abf701906c8c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Going to run 1 instances... {{(pid=122399) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 15:50:41.495117 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-95f7fb9d-7505-44e5-bcbb-abf701906c8c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a1434ad-0c2c-4725-baad-a605624baf01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 15:50:41.540347 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-95f7fb9d-7505-44e5-bcbb-abf701906c8c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.531432 Dec 16 15:50:41.541066 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 187/344] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Dec 16 15:50:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 16 15:50:41.545904 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-8a3f1111-e058-4411-a78b-301f0b75945e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:41.546150 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-8a3f1111-e058-4411-a78b-301f0b75945e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:41.552268 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8a3f1111-e058-4411-a78b-301f0b75945e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:41.552759 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8a3f1111-e058-4411-a78b-301f0b75945e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:41.553721 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8a3f1111-e058-4411-a78b-301f0b75945e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:41.554079 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8a3f1111-e058-4411-a78b-301f0b75945e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:41.689979 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-8a3f1111-e058-4411-a78b-301f0b75945e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:41.699882 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-8a3f1111-e058-4411-a78b-301f0b75945e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.157750 Dec 16 15:50:41.700893 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 188/345] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:41 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:41.705280 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-58509217-b4f7-44bb-884d-77ce3db96870 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:41.706008 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-58509217-b4f7-44bb-884d-77ce3db96870 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:41.712200 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-58509217-b4f7-44bb-884d-77ce3db96870 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:41.712726 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-58509217-b4f7-44bb-884d-77ce3db96870 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:41.713722 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-58509217-b4f7-44bb-884d-77ce3db96870 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:41.714124 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-58509217-b4f7-44bb-884d-77ce3db96870 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:41.849347 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-58509217-b4f7-44bb-884d-77ce3db96870 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:41.857452 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-58509217-b4f7-44bb-884d-77ce3db96870 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1471 microversion: 2.1 time: 0.155529 Dec 16 15:50:41.857964 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 189/346] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:41 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:41.871215 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-f5a9be99-8477-4fa0-838d-5a2ad4d26a4d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:41.871822 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-f5a9be99-8477-4fa0-838d-5a2ad4d26a4d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:41.921658 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-f5a9be99-8477-4fa0-838d-5a2ad4d26a4d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:41.928311 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-f5a9be99-8477-4fa0-838d-5a2ad4d26a4d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0" status: 200 len: 1218 microversion: 2.1 time: 0.060513 Dec 16 15:50:41.928884 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 190/347] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:41 2021] GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:42.717833 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ea6364fa-2538-4714-be18-603bcd213800 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:42.718397 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-ea6364fa-2538-4714-be18-603bcd213800 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:42.727056 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ea6364fa-2538-4714-be18-603bcd213800 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:42.727506 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ea6364fa-2538-4714-be18-603bcd213800 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:42.728325 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ea6364fa-2538-4714-be18-603bcd213800 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:42.728756 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ea6364fa-2538-4714-be18-603bcd213800 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:42.865220 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-ea6364fa-2538-4714-be18-603bcd213800 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:42.875161 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-ea6364fa-2538-4714-be18-603bcd213800 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.162812 Dec 16 15:50:42.875737 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 191/348] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:42 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:42.879971 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-67c44aab-e35a-4c6a-b112-fa337146ee84 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:42.880562 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-67c44aab-e35a-4c6a-b112-fa337146ee84 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:42.887845 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-67c44aab-e35a-4c6a-b112-fa337146ee84 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:42.888439 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-67c44aab-e35a-4c6a-b112-fa337146ee84 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:42.889676 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-67c44aab-e35a-4c6a-b112-fa337146ee84 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:42.890303 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-67c44aab-e35a-4c6a-b112-fa337146ee84 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:43.032343 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-67c44aab-e35a-4c6a-b112-fa337146ee84 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:43.039801 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-67c44aab-e35a-4c6a-b112-fa337146ee84 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1471 microversion: 2.1 time: 0.163164 Dec 16 15:50:43.040395 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 192/349] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:42 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1471 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:43.044563 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-6767a16f-f316-46bd-8aec-e553b6e6832e tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:43.045159 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-6767a16f-f316-46bd-8aec-e553b6e6832e tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:43.050579 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6767a16f-f316-46bd-8aec-e553b6e6832e tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:43.051024 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6767a16f-f316-46bd-8aec-e553b6e6832e tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:43.051803 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6767a16f-f316-46bd-8aec-e553b6e6832e tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:43.052241 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6767a16f-f316-46bd-8aec-e553b6e6832e tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:43.116444 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-6767a16f-f316-46bd-8aec-e553b6e6832e tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:43.124288 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-6767a16f-f316-46bd-8aec-e553b6e6832e tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0" status: 200 len: 1222 microversion: 2.1 time: 0.082964 Dec 16 15:50:43.124836 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 193/350] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:43 2021] GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:43.892375 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-6b8cc315-1f37-42fc-a2d6-28a3da7ff438 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:43.893055 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-6b8cc315-1f37-42fc-a2d6-28a3da7ff438 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:43.899904 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6b8cc315-1f37-42fc-a2d6-28a3da7ff438 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:43.900383 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6b8cc315-1f37-42fc-a2d6-28a3da7ff438 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:43.901228 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6b8cc315-1f37-42fc-a2d6-28a3da7ff438 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:43.901761 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6b8cc315-1f37-42fc-a2d6-28a3da7ff438 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:44.043040 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-6b8cc315-1f37-42fc-a2d6-28a3da7ff438 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:44.050363 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-6b8cc315-1f37-42fc-a2d6-28a3da7ff438 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.162261 Dec 16 15:50:44.051022 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 194/351] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:43 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:44.055396 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-efadd842-b2e8-497c-9332-3ca3534c9fca tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:44.055998 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-efadd842-b2e8-497c-9332-3ca3534c9fca tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:44.061761 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-efadd842-b2e8-497c-9332-3ca3534c9fca tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:44.062213 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-efadd842-b2e8-497c-9332-3ca3534c9fca tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:44.062992 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-efadd842-b2e8-497c-9332-3ca3534c9fca tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:44.063427 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-efadd842-b2e8-497c-9332-3ca3534c9fca tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:44.198830 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-efadd842-b2e8-497c-9332-3ca3534c9fca tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:44.207066 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-efadd842-b2e8-497c-9332-3ca3534c9fca tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1471 microversion: 2.1 time: 0.154965 Dec 16 15:50:44.207636 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 195/352] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:44 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:50:44.212046 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-0219deec-3b70-4143-aa40-d229317affd2 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:44.212683 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-0219deec-3b70-4143-aa40-d229317affd2 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:44.218732 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0219deec-3b70-4143-aa40-d229317affd2 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:44.219176 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0219deec-3b70-4143-aa40-d229317affd2 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:44.219950 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0219deec-3b70-4143-aa40-d229317affd2 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:44.220381 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0219deec-3b70-4143-aa40-d229317affd2 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:44.278677 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-0219deec-3b70-4143-aa40-d229317affd2 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:44.286198 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-0219deec-3b70-4143-aa40-d229317affd2 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0" status: 200 len: 1222 microversion: 2.1 time: 0.077625 Dec 16 15:50:44.286768 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 196/353] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:44 2021] GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0 => generated 1222 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:44.301399 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-a6164158-5090-4703-9368-cf92b3cd6257 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 28918 microversion: 2.1 time: 3.315238 Dec 16 15:50:44.302786 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 158/354] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:50:40 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 28918 bytes in 3318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:50:45.067536 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-209a547a-707d-4f60-b4f3-56d98b0f7e95 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:45.068165 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-209a547a-707d-4f60-b4f3-56d98b0f7e95 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:45.074325 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-209a547a-707d-4f60-b4f3-56d98b0f7e95 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:45.074939 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-209a547a-707d-4f60-b4f3-56d98b0f7e95 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:45.076294 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-209a547a-707d-4f60-b4f3-56d98b0f7e95 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:45.076777 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-209a547a-707d-4f60-b4f3-56d98b0f7e95 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:45.221873 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-209a547a-707d-4f60-b4f3-56d98b0f7e95 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:45.224978 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-d273b02b-e922-4309-b020-6811fee3a5d8 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:45.227631 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-d273b02b-e922-4309-b020-6811fee3a5d8 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:45.229749 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-209a547a-707d-4f60-b4f3-56d98b0f7e95 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.165770 Dec 16 15:50:45.239938 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 197/355] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:45 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:45.246252 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d273b02b-e922-4309-b020-6811fee3a5d8 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:45.247017 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d273b02b-e922-4309-b020-6811fee3a5d8 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:45.248059 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d273b02b-e922-4309-b020-6811fee3a5d8 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:45.248600 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d273b02b-e922-4309-b020-6811fee3a5d8 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:45.307039 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-9c3ff58c-65cb-41e4-81aa-29f9c1e3e9fa tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:45.307689 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-9c3ff58c-65cb-41e4-81aa-29f9c1e3e9fa tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:45.320267 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9c3ff58c-65cb-41e4-81aa-29f9c1e3e9fa tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:45.321190 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9c3ff58c-65cb-41e4-81aa-29f9c1e3e9fa tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:45.322212 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9c3ff58c-65cb-41e4-81aa-29f9c1e3e9fa tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:45.322855 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9c3ff58c-65cb-41e4-81aa-29f9c1e3e9fa tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:45.398788 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-9c3ff58c-65cb-41e4-81aa-29f9c1e3e9fa tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:45.407330 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-9c3ff58c-65cb-41e4-81aa-29f9c1e3e9fa tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0" status: 200 len: 1276 microversion: 2.1 time: 0.104282 Dec 16 15:50:45.408535 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 198/356] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:45 2021] GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0 => generated 1276 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:50:45.413624 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-6d5ac89c-fd83-41cb-8289-ab3409e49946 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:45.414956 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-6d5ac89c-fd83-41cb-8289-ab3409e49946 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:45.421201 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6d5ac89c-fd83-41cb-8289-ab3409e49946 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:45.421829 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6d5ac89c-fd83-41cb-8289-ab3409e49946 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:45.422686 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6d5ac89c-fd83-41cb-8289-ab3409e49946 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:45.423313 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6d5ac89c-fd83-41cb-8289-ab3409e49946 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:45.447106 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-d273b02b-e922-4309-b020-6811fee3a5d8 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:45.457351 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-d273b02b-e922-4309-b020-6811fee3a5d8 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1471 microversion: 2.1 time: 0.236957 Dec 16 15:50:45.458059 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 159/357] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:45 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1471 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:50:45.495851 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-6d5ac89c-fd83-41cb-8289-ab3409e49946 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 28918 microversion: 2.1 time: 0.085752 Dec 16 15:50:45.497278 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 199/358] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:50:45 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 28918 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:50:46.251142 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-d10e5a9d-2941-4938-8112-2120a6706601 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:46.252775 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-d10e5a9d-2941-4938-8112-2120a6706601 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:46.263577 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d10e5a9d-2941-4938-8112-2120a6706601 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:46.264280 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d10e5a9d-2941-4938-8112-2120a6706601 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:46.265508 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d10e5a9d-2941-4938-8112-2120a6706601 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:46.266093 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d10e5a9d-2941-4938-8112-2120a6706601 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:46.425517 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-857c60cc-622b-48ad-a3d4-b4f9861c84b8 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:46.426103 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-857c60cc-622b-48ad-a3d4-b4f9861c84b8 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:46.440314 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-857c60cc-622b-48ad-a3d4-b4f9861c84b8 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:46.441330 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-857c60cc-622b-48ad-a3d4-b4f9861c84b8 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:46.442481 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-857c60cc-622b-48ad-a3d4-b4f9861c84b8 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:46.443106 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-857c60cc-622b-48ad-a3d4-b4f9861c84b8 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:46.470347 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-d10e5a9d-2941-4938-8112-2120a6706601 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:46.486121 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-d10e5a9d-2941-4938-8112-2120a6706601 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1502 microversion: 2.1 time: 0.239491 Dec 16 15:50:46.487109 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 160/359] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:46 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1502 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:46.495100 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-85755b05-b4b3-4f44-8276-fed814418005 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:46.505532 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-85755b05-b4b3-4f44-8276-fed814418005 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:46.512726 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-85755b05-b4b3-4f44-8276-fed814418005 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:46.513398 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-85755b05-b4b3-4f44-8276-fed814418005 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:46.514448 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-85755b05-b4b3-4f44-8276-fed814418005 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:46.515180 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-85755b05-b4b3-4f44-8276-fed814418005 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:46.880475 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-857c60cc-622b-48ad-a3d4-b4f9861c84b8 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:46.895367 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-857c60cc-622b-48ad-a3d4-b4f9861c84b8 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0" status: 200 len: 1318 microversion: 2.1 time: 0.473931 Dec 16 15:50:46.901250 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 200/360] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:46 2021] GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0 => generated 1318 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:50:46.914762 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ae90f03d-cdd1-4730-baad-1fbe6d859a3f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2264b6ef-d12b-4e4e-861b-fe2970eb81aa"}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:46.915970 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-ae90f03d-cdd1-4730-baad-1fbe6d859a3f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:46.922050 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ae90f03d-cdd1-4730-baad-1fbe6d859a3f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:46.922719 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ae90f03d-cdd1-4730-baad-1fbe6d859a3f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:46.923720 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ae90f03d-cdd1-4730-baad-1fbe6d859a3f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:46.924153 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ae90f03d-cdd1-4730-baad-1fbe6d859a3f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:46.951921 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-85755b05-b4b3-4f44-8276-fed814418005 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:46.963784 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.wsgi [None req-ae90f03d-cdd1-4730-baad-1fbe6d859a3f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] HTTP exception thrown: Cannot 'attach_volume' instance 05750574-60a7-44f6-8fd6-d2fd52b57e91 while it is in vm_state rescued Dec 16 15:50:46.964374 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ae90f03d-cdd1-4730-baad-1fbe6d859a3f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Returning 409 to user: Cannot 'attach_volume' instance 05750574-60a7-44f6-8fd6-d2fd52b57e91 while it is in vm_state rescued {{(pid=122399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:50:46.965199 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-ae90f03d-cdd1-4730-baad-1fbe6d859a3f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "POST /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.062908 Dec 16 15:50:46.970405 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-85755b05-b4b3-4f44-8276-fed814418005 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1471 microversion: 2.1 time: 0.479099 Dec 16 15:50:46.975029 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 161/361] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:46 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1471 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:46.984229 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 201/362] 10.222.0.31 () {60 vars in 1322 bytes} [Thu Dec 16 15:50:46 2021] POST /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91/os-volume_attachments => generated 152 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 16 15:50:46.985990 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-8c86fe4a-b36b-4811-85e0-fc969b908549 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:46.986515 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-8c86fe4a-b36b-4811-85e0-fc969b908549 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:46.992122 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-1bfdf54b-d221-4f22-a2d8-465196eb4cf1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:47.005632 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-1bfdf54b-d221-4f22-a2d8-465196eb4cf1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:47.005914 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8c86fe4a-b36b-4811-85e0-fc969b908549 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:47.005914 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8c86fe4a-b36b-4811-85e0-fc969b908549 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:47.005914 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8c86fe4a-b36b-4811-85e0-fc969b908549 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:47.006202 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8c86fe4a-b36b-4811-85e0-fc969b908549 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:47.047907 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1bfdf54b-d221-4f22-a2d8-465196eb4cf1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:47.049982 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1bfdf54b-d221-4f22-a2d8-465196eb4cf1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:47.052018 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1bfdf54b-d221-4f22-a2d8-465196eb4cf1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:47.052874 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1bfdf54b-d221-4f22-a2d8-465196eb4cf1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:47.123684 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-8c86fe4a-b36b-4811-85e0-fc969b908549 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "POST /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91/action" status: 202 len: 0 microversion: 2.1 time: 0.141135 Dec 16 15:50:47.128621 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 202/363] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:50:46 2021] POST /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:50:47.152996 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-1bfdf54b-d221-4f22-a2d8-465196eb4cf1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 28918 microversion: 2.1 time: 0.174072 Dec 16 15:50:47.154250 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 162/364] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:50:46 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 28918 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:50:47.166541 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-a62bfa0e-e6dc-40ce-bd85-5f83bd518390 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:47.168456 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-a62bfa0e-e6dc-40ce-bd85-5f83bd518390 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:47.199339 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a62bfa0e-e6dc-40ce-bd85-5f83bd518390 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:47.201761 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a62bfa0e-e6dc-40ce-bd85-5f83bd518390 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:47.207752 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a62bfa0e-e6dc-40ce-bd85-5f83bd518390 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:47.210043 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a62bfa0e-e6dc-40ce-bd85-5f83bd518390 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:47.340052 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-1c114571-f119-4826-a635-7e49ae6ebe28 req-b50e867b-17f0-4f1a-8c1a-6af5ee2f786e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16cc9992-8538-4151-b169-681a3458fad0", "tag": "b6e9a2c2-ced6-4a5c-a5ae-564dd49086c3"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:47.342007 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:50:47.342007 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:50:47.352603 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-1c114571-f119-4826-a635-7e49ae6ebe28 req-b50e867b-17f0-4f1a-8c1a-6af5ee2f786e service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:47.360989 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-1c114571-f119-4826-a635-7e49ae6ebe28 req-b50e867b-17f0-4f1a-8c1a-6af5ee2f786e service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:47.385993 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-1c114571-f119-4826-a635-7e49ae6ebe28 req-b50e867b-17f0-4f1a-8c1a-6af5ee2f786e service nova] Creating event network-changed:b6e9a2c2-ced6-4a5c-a5ae-564dd49086c3 for instance 16cc9992-8538-4151-b169-681a3458fad0 on hv-cinder-78447 Dec 16 15:50:47.416931 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-1c114571-f119-4826-a635-7e49ae6ebe28 req-b50e867b-17f0-4f1a-8c1a-6af5ee2f786e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081337 Dec 16 15:50:47.418678 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 163/365] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:50:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:50:47.509468 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-a62bfa0e-e6dc-40ce-bd85-5f83bd518390 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:47.525251 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-a62bfa0e-e6dc-40ce-bd85-5f83bd518390 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1510 microversion: 2.1 time: 0.393822 Dec 16 15:50:47.538389 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 203/366] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:47 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1510 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:47.647428 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-76a8ee73-dfe5-4af5-8056-fe53fff2f34b req-47c252f8-1161-4332-a0e4-5bfb2ec9bfe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57099c29-992b-4d24-9ce5-251ac704d335", "name": "network-vif-deleted", "tag": "07e7c44a-e6c2-471c-93ac-f346f0ad0d93"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:47.650051 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:50:47.650051 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:50:47.658237 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-76a8ee73-dfe5-4af5-8056-fe53fff2f34b req-47c252f8-1161-4332-a0e4-5bfb2ec9bfe9 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:47.659122 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-76a8ee73-dfe5-4af5-8056-fe53fff2f34b req-47c252f8-1161-4332-a0e4-5bfb2ec9bfe9 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:47.672719 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-76a8ee73-dfe5-4af5-8056-fe53fff2f34b req-47c252f8-1161-4332-a0e4-5bfb2ec9bfe9 service nova] Creating event network-vif-deleted:07e7c44a-e6c2-471c-93ac-f346f0ad0d93 for instance 57099c29-992b-4d24-9ce5-251ac704d335 on hv-cinder-78447 Dec 16 15:50:47.678602 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-76a8ee73-dfe5-4af5-8056-fe53fff2f34b req-47c252f8-1161-4332-a0e4-5bfb2ec9bfe9 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035638 Dec 16 15:50:47.679410 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 164/367] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:50:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:50:47.917707 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-256dc64a-76c2-4990-9636-85c8a22015cf tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:47.918582 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-256dc64a-76c2-4990-9636-85c8a22015cf tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:47.924638 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-256dc64a-76c2-4990-9636-85c8a22015cf tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:47.925158 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-256dc64a-76c2-4990-9636-85c8a22015cf tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:47.926188 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-256dc64a-76c2-4990-9636-85c8a22015cf tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:47.926570 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-256dc64a-76c2-4990-9636-85c8a22015cf tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:47.993225 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-4204382e-ad24-4fac-8934-677673ef07f2 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:47.994273 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-4204382e-ad24-4fac-8934-677673ef07f2 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:48.001117 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4204382e-ad24-4fac-8934-677673ef07f2 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:48.002125 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4204382e-ad24-4fac-8934-677673ef07f2 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:48.003136 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4204382e-ad24-4fac-8934-677673ef07f2 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:48.003794 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4204382e-ad24-4fac-8934-677673ef07f2 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:48.224861 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-4204382e-ad24-4fac-8934-677673ef07f2 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:48.233868 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-4204382e-ad24-4fac-8934-677673ef07f2 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1429 microversion: 2.1 time: 0.245665 Dec 16 15:50:48.235709 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 165/368] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:47 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1429 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:48.240822 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-d2ba5e7d-5cfb-44bd-8de3-77d582b05f63 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:48.242056 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-d2ba5e7d-5cfb-44bd-8de3-77d582b05f63 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:48.248359 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d2ba5e7d-5cfb-44bd-8de3-77d582b05f63 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:48.249041 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d2ba5e7d-5cfb-44bd-8de3-77d582b05f63 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:48.250497 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d2ba5e7d-5cfb-44bd-8de3-77d582b05f63 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:48.251113 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d2ba5e7d-5cfb-44bd-8de3-77d582b05f63 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:48.320047 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-256dc64a-76c2-4990-9636-85c8a22015cf tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:48.327711 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-256dc64a-76c2-4990-9636-85c8a22015cf tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0" status: 200 len: 1318 microversion: 2.1 time: 0.414065 Dec 16 15:50:48.333891 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 204/369] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:47 2021] GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0 => generated 1318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:48.545810 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ef845b12-aa2d-45ac-83af-3133d956a754 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:48.546421 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-ef845b12-aa2d-45ac-83af-3133d956a754 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:48.552942 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ef845b12-aa2d-45ac-83af-3133d956a754 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:48.553384 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ef845b12-aa2d-45ac-83af-3133d956a754 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:48.554204 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ef845b12-aa2d-45ac-83af-3133d956a754 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:48.554629 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ef845b12-aa2d-45ac-83af-3133d956a754 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:48.693538 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-ef845b12-aa2d-45ac-83af-3133d956a754 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:48.701210 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-ef845b12-aa2d-45ac-83af-3133d956a754 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1510 microversion: 2.1 time: 0.159115 Dec 16 15:50:48.702316 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 205/370] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:48 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:49.251868 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-6d9a45e5-2f0c-4a29-bdbf-71e668a7c822 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:49.252512 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-6d9a45e5-2f0c-4a29-bdbf-71e668a7c822 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:49.258362 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6d9a45e5-2f0c-4a29-bdbf-71e668a7c822 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:49.258805 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6d9a45e5-2f0c-4a29-bdbf-71e668a7c822 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:49.259697 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6d9a45e5-2f0c-4a29-bdbf-71e668a7c822 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:49.260313 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6d9a45e5-2f0c-4a29-bdbf-71e668a7c822 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:49.349580 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-6d9a45e5-2f0c-4a29-bdbf-71e668a7c822 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:49.358536 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-6d9a45e5-2f0c-4a29-bdbf-71e668a7c822 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1429 microversion: 2.1 time: 0.111457 Dec 16 15:50:49.368816 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 206/371] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:49 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1429 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:50:49.374039 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-026e100d-f375-4841-bc13-52dd0300f17b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:49.374655 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-026e100d-f375-4841-bc13-52dd0300f17b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:49.381735 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-026e100d-f375-4841-bc13-52dd0300f17b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:49.382184 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-026e100d-f375-4841-bc13-52dd0300f17b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:49.382978 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-026e100d-f375-4841-bc13-52dd0300f17b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:49.383426 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-026e100d-f375-4841-bc13-52dd0300f17b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:49.535614 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-026e100d-f375-4841-bc13-52dd0300f17b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:49.543011 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-026e100d-f375-4841-bc13-52dd0300f17b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0" status: 200 len: 1318 microversion: 2.1 time: 0.172732 Dec 16 15:50:49.543819 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 207/372] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:49 2021] GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:49.719102 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-fd3608fb-8341-4565-b6eb-ee1b82eda620 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:49.719910 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-fd3608fb-8341-4565-b6eb-ee1b82eda620 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:49.726333 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-fd3608fb-8341-4565-b6eb-ee1b82eda620 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:49.726857 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-fd3608fb-8341-4565-b6eb-ee1b82eda620 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:49.727722 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-fd3608fb-8341-4565-b6eb-ee1b82eda620 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:49.728224 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-fd3608fb-8341-4565-b6eb-ee1b82eda620 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:49.862150 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-fd3608fb-8341-4565-b6eb-ee1b82eda620 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:49.869501 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-fd3608fb-8341-4565-b6eb-ee1b82eda620 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1510 microversion: 2.1 time: 0.155258 Dec 16 15:50:49.870065 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 208/373] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:49 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:50:50.375972 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-4095c558-db40-441a-a828-862186187989 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:50.376577 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-4095c558-db40-441a-a828-862186187989 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:50.383040 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4095c558-db40-441a-a828-862186187989 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:50.383488 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4095c558-db40-441a-a828-862186187989 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:50.384263 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4095c558-db40-441a-a828-862186187989 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:50.384689 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4095c558-db40-441a-a828-862186187989 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:50.446582 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-4095c558-db40-441a-a828-862186187989 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:50.457743 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-4095c558-db40-441a-a828-862186187989 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1429 microversion: 2.1 time: 0.085268 Dec 16 15:50:50.458409 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 209/374] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:50 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1429 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:50.560426 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-5624126d-cccf-481e-b56b-bdbb6698609d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:50.560948 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-5624126d-cccf-481e-b56b-bdbb6698609d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:50.567922 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5624126d-cccf-481e-b56b-bdbb6698609d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:50.568404 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5624126d-cccf-481e-b56b-bdbb6698609d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:50.569173 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5624126d-cccf-481e-b56b-bdbb6698609d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:50.569641 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5624126d-cccf-481e-b56b-bdbb6698609d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:50.738097 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-5624126d-cccf-481e-b56b-bdbb6698609d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:50.741801 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-d2ba5e7d-5cfb-44bd-8de3-77d582b05f63 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 28918 microversion: 2.1 time: 2.504511 Dec 16 15:50:50.746235 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 166/375] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:50:48 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 28918 bytes in 2506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:50:50.746393 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-5624126d-cccf-481e-b56b-bdbb6698609d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0" status: 200 len: 1318 microversion: 2.1 time: 0.188882 Dec 16 15:50:50.759789 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 210/376] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:50 2021] GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:50.890274 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-d7dcbd3e-51da-4bf9-b2a1-cbcb9ea0bd97 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:50.891117 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-d7dcbd3e-51da-4bf9-b2a1-cbcb9ea0bd97 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:50.899046 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d7dcbd3e-51da-4bf9-b2a1-cbcb9ea0bd97 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:50.899747 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d7dcbd3e-51da-4bf9-b2a1-cbcb9ea0bd97 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:50.900702 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d7dcbd3e-51da-4bf9-b2a1-cbcb9ea0bd97 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:50.901144 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d7dcbd3e-51da-4bf9-b2a1-cbcb9ea0bd97 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:51.040614 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-d7dcbd3e-51da-4bf9-b2a1-cbcb9ea0bd97 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:51.048822 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-d7dcbd3e-51da-4bf9-b2a1-cbcb9ea0bd97 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1510 microversion: 2.1 time: 0.162583 Dec 16 15:50:51.049496 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 167/377] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:50 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:51.478692 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-1b991ec1-7e0c-4929-ac86-4dc1ab3cfe45 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:51.479339 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-1b991ec1-7e0c-4929-ac86-4dc1ab3cfe45 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:51.485211 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1b991ec1-7e0c-4929-ac86-4dc1ab3cfe45 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:51.485704 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1b991ec1-7e0c-4929-ac86-4dc1ab3cfe45 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:51.486524 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1b991ec1-7e0c-4929-ac86-4dc1ab3cfe45 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:51.487120 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1b991ec1-7e0c-4929-ac86-4dc1ab3cfe45 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:51.517559 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1b991ec1-7e0c-4929-ac86-4dc1ab3cfe45 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:51.517937 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1b991ec1-7e0c-4929-ac86-4dc1ab3cfe45 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:51.518376 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.objects.instance [None req-1b991ec1-7e0c-4929-ac86-4dc1ab3cfe45 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lazy-loading 'fault' on Instance uuid 57099c29-992b-4d24-9ce5-251ac704d335 {{(pid=122399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:50:51.558942 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-1b991ec1-7e0c-4929-ac86-4dc1ab3cfe45 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab314c4f90b42698961c9a019a7d86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f0ef78d0784036a0c421741c8de20e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:51.566461 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-1b991ec1-7e0c-4929-ac86-4dc1ab3cfe45 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 200 len: 1305 microversion: 2.1 time: 0.091978 Dec 16 15:50:51.567020 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 211/378] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:51 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 1305 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:50:51.754217 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-39251c0d-f1cc-4716-b9ec-37bf8b4a3e19 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:51.755262 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-39251c0d-f1cc-4716-b9ec-37bf8b4a3e19 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:51.761940 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-39251c0d-f1cc-4716-b9ec-37bf8b4a3e19 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:51.762406 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-a6e5f10c-d57c-4773-8ca9-c068ef111bd6 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:51.762852 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-39251c0d-f1cc-4716-b9ec-37bf8b4a3e19 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:51.763049 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-a6e5f10c-d57c-4773-8ca9-c068ef111bd6 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:51.763165 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-39251c0d-f1cc-4716-b9ec-37bf8b4a3e19 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:51.763851 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-39251c0d-f1cc-4716-b9ec-37bf8b4a3e19 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:51.771313 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a6e5f10c-d57c-4773-8ca9-c068ef111bd6 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:51.771651 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a6e5f10c-d57c-4773-8ca9-c068ef111bd6 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:51.772435 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a6e5f10c-d57c-4773-8ca9-c068ef111bd6 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:51.772859 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a6e5f10c-d57c-4773-8ca9-c068ef111bd6 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:51.871354 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-39251c0d-f1cc-4716-b9ec-37bf8b4a3e19 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 28918 microversion: 2.1 time: 0.121209 Dec 16 15:50:51.872369 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 168/379] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:50:51 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 28918 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:50:51.944281 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-a6e5f10c-d57c-4773-8ca9-c068ef111bd6 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:51.952041 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-a6e5f10c-d57c-4773-8ca9-c068ef111bd6 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0" status: 200 len: 1318 microversion: 2.1 time: 0.194327 Dec 16 15:50:51.952610 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 212/380] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:51 2021] GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:50:52.065998 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-36e81d51-c233-4ad8-8ee2-d730eac6976b tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:52.066695 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-36e81d51-c233-4ad8-8ee2-d730eac6976b tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:52.073396 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-36e81d51-c233-4ad8-8ee2-d730eac6976b tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:52.073873 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-36e81d51-c233-4ad8-8ee2-d730eac6976b tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:52.074644 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-36e81d51-c233-4ad8-8ee2-d730eac6976b tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:52.075067 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-36e81d51-c233-4ad8-8ee2-d730eac6976b tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:52.206430 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-36e81d51-c233-4ad8-8ee2-d730eac6976b tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:52.214316 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-36e81d51-c233-4ad8-8ee2-d730eac6976b tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1510 microversion: 2.1 time: 0.152407 Dec 16 15:50:52.214876 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 169/381] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:52 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:52.583390 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-2e915aa9-82f5-40fc-855a-1790f7a852c2 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:52.583997 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-2e915aa9-82f5-40fc-855a-1790f7a852c2 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] [instance: 57099c29-992b-4d24-9ce5-251ac704d335] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:52.589996 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2e915aa9-82f5-40fc-855a-1790f7a852c2 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:52.590347 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2e915aa9-82f5-40fc-855a-1790f7a852c2 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:52.591121 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2e915aa9-82f5-40fc-855a-1790f7a852c2 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:52.591539 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2e915aa9-82f5-40fc-855a-1790f7a852c2 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:52.610348 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.wsgi [None req-2e915aa9-82f5-40fc-855a-1790f7a852c2 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] HTTP exception thrown: Instance 57099c29-992b-4d24-9ce5-251ac704d335 could not be found. Dec 16 15:50:52.611046 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-2e915aa9-82f5-40fc-855a-1790f7a852c2 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] Returning 404 to user: Instance 57099c29-992b-4d24-9ce5-251ac704d335 could not be found. {{(pid=122399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:50:52.611849 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-2e915aa9-82f5-40fc-855a-1790f7a852c2 tempest-VolumesNegativeTest-845494288 tempest-VolumesNegativeTest-845494288-project] 10.222.0.31 "GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335" status: 404 len: 111 microversion: 2.1 time: 0.032278 Dec 16 15:50:52.612405 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 213/382] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:52 2021] GET /compute/v2.1/servers/57099c29-992b-4d24-9ce5-251ac704d335 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:50:52.884079 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-f45d4f75-fb2f-4d2c-8a9f-671a0a85af42 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:52.884994 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-f45d4f75-fb2f-4d2c-8a9f-671a0a85af42 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:52.891452 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f45d4f75-fb2f-4d2c-8a9f-671a0a85af42 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:52.891937 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f45d4f75-fb2f-4d2c-8a9f-671a0a85af42 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:52.892710 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f45d4f75-fb2f-4d2c-8a9f-671a0a85af42 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:52.893307 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f45d4f75-fb2f-4d2c-8a9f-671a0a85af42 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:52.968766 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-e29e8f9f-3a2e-4541-a3dc-36af103a9504 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:52.969434 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-e29e8f9f-3a2e-4541-a3dc-36af103a9504 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:52.976793 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e29e8f9f-3a2e-4541-a3dc-36af103a9504 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:52.977243 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e29e8f9f-3a2e-4541-a3dc-36af103a9504 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:52.978086 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e29e8f9f-3a2e-4541-a3dc-36af103a9504 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:52.978513 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e29e8f9f-3a2e-4541-a3dc-36af103a9504 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:53.115535 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-e29e8f9f-3a2e-4541-a3dc-36af103a9504 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:53.123412 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-e29e8f9f-3a2e-4541-a3dc-36af103a9504 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0" status: 200 len: 1318 microversion: 2.1 time: 0.158402 Dec 16 15:50:53.123972 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 214/383] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:52 2021] GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:53.230655 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-c5618aab-d32f-485f-ab7b-9ff19c794a66 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:53.231266 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-c5618aab-d32f-485f-ab7b-9ff19c794a66 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:53.237872 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c5618aab-d32f-485f-ab7b-9ff19c794a66 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:53.238317 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c5618aab-d32f-485f-ab7b-9ff19c794a66 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:53.239099 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c5618aab-d32f-485f-ab7b-9ff19c794a66 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:53.239528 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c5618aab-d32f-485f-ab7b-9ff19c794a66 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:53.373721 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-c5618aab-d32f-485f-ab7b-9ff19c794a66 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:53.381037 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-c5618aab-d32f-485f-ab7b-9ff19c794a66 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1510 microversion: 2.1 time: 0.154081 Dec 16 15:50:53.381710 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 215/384] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:53 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:54.139872 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-007ab67c-a67a-439e-bd29-6b36b69782a5 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:54.140506 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-007ab67c-a67a-439e-bd29-6b36b69782a5 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:54.147107 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-007ab67c-a67a-439e-bd29-6b36b69782a5 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:54.147550 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-007ab67c-a67a-439e-bd29-6b36b69782a5 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:54.148325 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-007ab67c-a67a-439e-bd29-6b36b69782a5 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:54.148754 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-007ab67c-a67a-439e-bd29-6b36b69782a5 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:54.302307 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-007ab67c-a67a-439e-bd29-6b36b69782a5 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:54.311246 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-007ab67c-a67a-439e-bd29-6b36b69782a5 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0" status: 200 len: 1318 microversion: 2.1 time: 0.174996 Dec 16 15:50:54.311972 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 216/385] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:54 2021] GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:54.397963 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-dfc9c083-7d1b-4ac1-9685-837d607b46b5 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:54.399517 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-dfc9c083-7d1b-4ac1-9685-837d607b46b5 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:54.406737 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-dfc9c083-7d1b-4ac1-9685-837d607b46b5 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:54.407183 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-dfc9c083-7d1b-4ac1-9685-837d607b46b5 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:54.408023 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-dfc9c083-7d1b-4ac1-9685-837d607b46b5 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:54.408454 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-dfc9c083-7d1b-4ac1-9685-837d607b46b5 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:54.550436 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-dfc9c083-7d1b-4ac1-9685-837d607b46b5 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:54.558010 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-dfc9c083-7d1b-4ac1-9685-837d607b46b5 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1510 microversion: 2.1 time: 0.163630 Dec 16 15:50:54.558609 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 217/386] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:54 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:55.327704 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-f4faefe9-5b8a-401b-a028-c54e755d4d34 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:55.328297 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-f4faefe9-5b8a-401b-a028-c54e755d4d34 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:55.335367 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f4faefe9-5b8a-401b-a028-c54e755d4d34 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:55.335829 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f4faefe9-5b8a-401b-a028-c54e755d4d34 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:55.336744 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f4faefe9-5b8a-401b-a028-c54e755d4d34 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:55.337259 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f4faefe9-5b8a-401b-a028-c54e755d4d34 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:55.347978 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-f45d4f75-fb2f-4d2c-8a9f-671a0a85af42 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 28918 microversion: 2.1 time: 2.467737 Dec 16 15:50:55.349680 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 170/387] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:50:52 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 28918 bytes in 2469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:50:55.469940 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-f4faefe9-5b8a-401b-a028-c54e755d4d34 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:55.477588 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-f4faefe9-5b8a-401b-a028-c54e755d4d34 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0" status: 200 len: 1318 microversion: 2.1 time: 0.153494 Dec 16 15:50:55.478331 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 218/388] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:55 2021] GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:50:55.575703 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-6d10fbc3-6e64-4e53-b822-aa22f0ae1b39 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:55.576417 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-6d10fbc3-6e64-4e53-b822-aa22f0ae1b39 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:55.583430 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6d10fbc3-6e64-4e53-b822-aa22f0ae1b39 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:55.583864 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6d10fbc3-6e64-4e53-b822-aa22f0ae1b39 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:55.584631 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6d10fbc3-6e64-4e53-b822-aa22f0ae1b39 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:55.585051 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6d10fbc3-6e64-4e53-b822-aa22f0ae1b39 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:55.729861 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-6d10fbc3-6e64-4e53-b822-aa22f0ae1b39 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:55.737701 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-6d10fbc3-6e64-4e53-b822-aa22f0ae1b39 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1510 microversion: 2.1 time: 0.165989 Dec 16 15:50:55.738274 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 171/389] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:55 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:56.360032 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-9611ebe0-f7c8-42aa-848e-6b4c5dca8c2b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:56.360971 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-9611ebe0-f7c8-42aa-848e-6b4c5dca8c2b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:56.367384 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9611ebe0-f7c8-42aa-848e-6b4c5dca8c2b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:56.367735 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9611ebe0-f7c8-42aa-848e-6b4c5dca8c2b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:56.368502 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9611ebe0-f7c8-42aa-848e-6b4c5dca8c2b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:56.368929 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9611ebe0-f7c8-42aa-848e-6b4c5dca8c2b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:56.498609 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-02066794-ed6b-40a4-aa44-9c73a0ae516c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:56.499611 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-02066794-ed6b-40a4-aa44-9c73a0ae516c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:56.507683 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-02066794-ed6b-40a4-aa44-9c73a0ae516c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:56.508132 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-02066794-ed6b-40a4-aa44-9c73a0ae516c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:56.508906 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-02066794-ed6b-40a4-aa44-9c73a0ae516c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:56.509336 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-02066794-ed6b-40a4-aa44-9c73a0ae516c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:56.642682 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-02066794-ed6b-40a4-aa44-9c73a0ae516c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:56.650539 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-02066794-ed6b-40a4-aa44-9c73a0ae516c tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0" status: 200 len: 1318 microversion: 2.1 time: 0.158194 Dec 16 15:50:56.651094 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 172/390] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:56 2021] GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:56.758229 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-a4ac8ead-1875-4377-a7e9-7d54af0b061d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:56.759212 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-a4ac8ead-1875-4377-a7e9-7d54af0b061d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:56.771041 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a4ac8ead-1875-4377-a7e9-7d54af0b061d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:56.771041 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a4ac8ead-1875-4377-a7e9-7d54af0b061d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:56.771983 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a4ac8ead-1875-4377-a7e9-7d54af0b061d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:56.772689 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a4ac8ead-1875-4377-a7e9-7d54af0b061d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:56.909750 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-a4ac8ead-1875-4377-a7e9-7d54af0b061d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:56.917682 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-a4ac8ead-1875-4377-a7e9-7d54af0b061d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1510 microversion: 2.1 time: 0.165494 Dec 16 15:50:56.918255 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 173/391] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:56 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:57.670885 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-7a74b28a-916b-480d-98b9-2c7d65388114 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:57.671489 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-7a74b28a-916b-480d-98b9-2c7d65388114 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:57.677913 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7a74b28a-916b-480d-98b9-2c7d65388114 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:57.678348 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7a74b28a-916b-480d-98b9-2c7d65388114 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:57.679116 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7a74b28a-916b-480d-98b9-2c7d65388114 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:57.679538 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7a74b28a-916b-480d-98b9-2c7d65388114 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:57.822570 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-7a74b28a-916b-480d-98b9-2c7d65388114 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:57.830016 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-7a74b28a-916b-480d-98b9-2c7d65388114 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0" status: 200 len: 1318 microversion: 2.1 time: 0.162813 Dec 16 15:50:57.830585 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 174/392] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:57 2021] GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:50:57.935045 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-f17e486d-522b-4f24-bd2d-8e2bf53c06fb tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:57.935651 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-f17e486d-522b-4f24-bd2d-8e2bf53c06fb tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:57.943465 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f17e486d-522b-4f24-bd2d-8e2bf53c06fb tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:57.943911 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f17e486d-522b-4f24-bd2d-8e2bf53c06fb tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:57.944984 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f17e486d-522b-4f24-bd2d-8e2bf53c06fb tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:57.945797 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f17e486d-522b-4f24-bd2d-8e2bf53c06fb tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:58.072296 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-f17e486d-522b-4f24-bd2d-8e2bf53c06fb tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:58.080082 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-f17e486d-522b-4f24-bd2d-8e2bf53c06fb tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1510 microversion: 2.1 time: 0.148840 Dec 16 15:50:58.080649 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 175/393] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:57 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:58.792197 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-9611ebe0-f7c8-42aa-848e-6b4c5dca8c2b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 28918 microversion: 2.1 time: 2.435625 Dec 16 15:50:58.792952 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 219/394] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:50:56 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 28918 bytes in 2437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:50:58.847502 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-1fd79b83-f539-42d1-be37-2d829aee5ac7 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:58.848081 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-1fd79b83-f539-42d1-be37-2d829aee5ac7 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:58.855165 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1fd79b83-f539-42d1-be37-2d829aee5ac7 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:58.855608 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1fd79b83-f539-42d1-be37-2d829aee5ac7 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:58.856380 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1fd79b83-f539-42d1-be37-2d829aee5ac7 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:58.856804 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1fd79b83-f539-42d1-be37-2d829aee5ac7 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:58.990463 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-1fd79b83-f539-42d1-be37-2d829aee5ac7 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:59.001154 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-1fd79b83-f539-42d1-be37-2d829aee5ac7 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0" status: 200 len: 1318 microversion: 2.1 time: 0.157367 Dec 16 15:50:59.001849 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 176/395] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:58 2021] GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:59.097276 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-df7d1c7b-49d0-4d77-a8e4-71edca526f06 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:50:59.097972 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-df7d1c7b-49d0-4d77-a8e4-71edca526f06 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:59.105189 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-df7d1c7b-49d0-4d77-a8e4-71edca526f06 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:59.105665 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-df7d1c7b-49d0-4d77-a8e4-71edca526f06 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:59.106430 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-df7d1c7b-49d0-4d77-a8e4-71edca526f06 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:59.106855 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-df7d1c7b-49d0-4d77-a8e4-71edca526f06 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:59.253365 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-df7d1c7b-49d0-4d77-a8e4-71edca526f06 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:50:59.261000 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-df7d1c7b-49d0-4d77-a8e4-71edca526f06 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1510 microversion: 2.1 time: 0.167674 Dec 16 15:50:59.261545 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 220/396] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:50:59 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:50:59.807261 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-9db0498f-d1b8-4804-a2a8-a2f45709efc5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:50:59.808866 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-9db0498f-d1b8-4804-a2a8-a2f45709efc5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:50:59.819025 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9db0498f-d1b8-4804-a2a8-a2f45709efc5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:59.819765 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9db0498f-d1b8-4804-a2a8-a2f45709efc5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:50:59.821046 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9db0498f-d1b8-4804-a2a8-a2f45709efc5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:50:59.821842 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9db0498f-d1b8-4804-a2a8-a2f45709efc5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:00.018010 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-34300781-57ab-42a1-84d5-98bae97643e8 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:00.018720 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-34300781-57ab-42a1-84d5-98bae97643e8 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:00.025177 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-34300781-57ab-42a1-84d5-98bae97643e8 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:00.025661 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-34300781-57ab-42a1-84d5-98bae97643e8 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:00.026447 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-34300781-57ab-42a1-84d5-98bae97643e8 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:00.026862 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-34300781-57ab-42a1-84d5-98bae97643e8 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:00.156018 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-34300781-57ab-42a1-84d5-98bae97643e8 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:00.163353 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-34300781-57ab-42a1-84d5-98bae97643e8 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0" status: 200 len: 1318 microversion: 2.1 time: 0.148983 Dec 16 15:51:00.163912 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 221/397] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:00 2021] GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:00.282946 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-b291bb8f-bdc3-4d76-8c0e-4e97f63a29d8 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:00.284094 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-b291bb8f-bdc3-4d76-8c0e-4e97f63a29d8 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:00.291660 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b291bb8f-bdc3-4d76-8c0e-4e97f63a29d8 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:00.292159 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b291bb8f-bdc3-4d76-8c0e-4e97f63a29d8 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:00.292970 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b291bb8f-bdc3-4d76-8c0e-4e97f63a29d8 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:00.293433 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b291bb8f-bdc3-4d76-8c0e-4e97f63a29d8 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:00.428712 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-b291bb8f-bdc3-4d76-8c0e-4e97f63a29d8 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:00.436077 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-b291bb8f-bdc3-4d76-8c0e-4e97f63a29d8 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1510 microversion: 2.1 time: 0.159884 Dec 16 15:51:00.436643 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 222/398] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:00 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:01.184558 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-80f18298-3761-4ba6-87e1-68dd23139b03 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:01.185198 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-80f18298-3761-4ba6-87e1-68dd23139b03 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:01.191954 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-80f18298-3761-4ba6-87e1-68dd23139b03 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:01.192398 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-80f18298-3761-4ba6-87e1-68dd23139b03 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:01.193212 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-80f18298-3761-4ba6-87e1-68dd23139b03 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:01.193678 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-80f18298-3761-4ba6-87e1-68dd23139b03 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:01.342774 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-80f18298-3761-4ba6-87e1-68dd23139b03 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:01.352929 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-80f18298-3761-4ba6-87e1-68dd23139b03 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0" status: 200 len: 1318 microversion: 2.1 time: 0.171992 Dec 16 15:51:01.353525 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 223/399] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:01 2021] GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:01.452054 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-4ac33729-b03c-49c0-8097-49f03c14cc41 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:01.452670 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-4ac33729-b03c-49c0-8097-49f03c14cc41 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:01.459088 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4ac33729-b03c-49c0-8097-49f03c14cc41 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:01.459537 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4ac33729-b03c-49c0-8097-49f03c14cc41 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:01.460311 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4ac33729-b03c-49c0-8097-49f03c14cc41 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:01.460742 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4ac33729-b03c-49c0-8097-49f03c14cc41 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:01.594712 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-4ac33729-b03c-49c0-8097-49f03c14cc41 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:01.602234 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-4ac33729-b03c-49c0-8097-49f03c14cc41 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1510 microversion: 2.1 time: 0.153782 Dec 16 15:51:01.602795 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 224/400] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:01 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:02.205427 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-9db0498f-d1b8-4804-a2a8-a2f45709efc5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 28918 microversion: 2.1 time: 2.404203 Dec 16 15:51:02.206530 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 177/401] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:50:59 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 28918 bytes in 2406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:51:02.377299 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-36259fe6-010d-4fc3-97b5-c1ab8c1f25d3 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:02.378219 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-36259fe6-010d-4fc3-97b5-c1ab8c1f25d3 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:02.385292 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-36259fe6-010d-4fc3-97b5-c1ab8c1f25d3 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:02.385765 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-36259fe6-010d-4fc3-97b5-c1ab8c1f25d3 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:02.386531 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-36259fe6-010d-4fc3-97b5-c1ab8c1f25d3 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:02.386952 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-36259fe6-010d-4fc3-97b5-c1ab8c1f25d3 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:02.521164 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-36259fe6-010d-4fc3-97b5-c1ab8c1f25d3 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:02.528787 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-36259fe6-010d-4fc3-97b5-c1ab8c1f25d3 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0" status: 200 len: 1318 microversion: 2.1 time: 0.157659 Dec 16 15:51:02.529341 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 225/402] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:02 2021] GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:02.620371 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-fae366b7-d793-4328-959c-a53c8b71fd25 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:02.621063 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-fae366b7-d793-4328-959c-a53c8b71fd25 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:02.628292 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-fae366b7-d793-4328-959c-a53c8b71fd25 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:02.628681 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-fae366b7-d793-4328-959c-a53c8b71fd25 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:02.629603 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-fae366b7-d793-4328-959c-a53c8b71fd25 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:02.630309 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-fae366b7-d793-4328-959c-a53c8b71fd25 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:02.783014 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-fae366b7-d793-4328-959c-a53c8b71fd25 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:02.790392 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-fae366b7-d793-4328-959c-a53c8b71fd25 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1516 microversion: 2.1 time: 0.174338 Dec 16 15:51:02.790958 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 178/403] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:02 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:03.217374 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-3cff125c-09a3-4e0f-91b6-e30c6ffed0f3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:03.218799 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-3cff125c-09a3-4e0f-91b6-e30c6ffed0f3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:03.226993 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3cff125c-09a3-4e0f-91b6-e30c6ffed0f3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:03.227439 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3cff125c-09a3-4e0f-91b6-e30c6ffed0f3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:03.228285 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3cff125c-09a3-4e0f-91b6-e30c6ffed0f3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:03.228669 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3cff125c-09a3-4e0f-91b6-e30c6ffed0f3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:03.316616 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-3cff125c-09a3-4e0f-91b6-e30c6ffed0f3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 28918 microversion: 2.1 time: 0.103067 Dec 16 15:51:03.317666 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 226/404] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:51:03 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 28918 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:51:03.545255 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-d7db81e9-dcc4-4228-b404-3a1366b842aa tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:03.546587 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-d7db81e9-dcc4-4228-b404-3a1366b842aa tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:03.553563 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d7db81e9-dcc4-4228-b404-3a1366b842aa tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:03.554427 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d7db81e9-dcc4-4228-b404-3a1366b842aa tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:03.555429 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d7db81e9-dcc4-4228-b404-3a1366b842aa tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:03.556074 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d7db81e9-dcc4-4228-b404-3a1366b842aa tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:03.718723 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-d7db81e9-dcc4-4228-b404-3a1366b842aa tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:03.726936 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-d7db81e9-dcc4-4228-b404-3a1366b842aa tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0" status: 200 len: 1318 microversion: 2.1 time: 0.185216 Dec 16 15:51:03.727510 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 179/405] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:03 2021] GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:04.132394 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-1684af9f-f630-4af5-8991-1cde085e2148 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:04.133079 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-1684af9f-f630-4af5-8991-1cde085e2148 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:04.139913 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1684af9f-f630-4af5-8991-1cde085e2148 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:04.140364 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1684af9f-f630-4af5-8991-1cde085e2148 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:04.141140 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1684af9f-f630-4af5-8991-1cde085e2148 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:04.141610 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1684af9f-f630-4af5-8991-1cde085e2148 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:04.273113 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-1684af9f-f630-4af5-8991-1cde085e2148 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:04.280492 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-1684af9f-f630-4af5-8991-1cde085e2148 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1516 microversion: 2.1 time: 0.152120 Dec 16 15:51:04.281074 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 227/406] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:04 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:04.296258 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-bffd57a9-6f1e-4435-aa50-4017e25a2f78 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a0e5f9f-fb4f-4d55-a7fd-ec07d618446a"}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:04.297330 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-bffd57a9-6f1e-4435-aa50-4017e25a2f78 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:04.303705 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-bffd57a9-6f1e-4435-aa50-4017e25a2f78 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:04.304147 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-bffd57a9-6f1e-4435-aa50-4017e25a2f78 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:04.304938 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-bffd57a9-6f1e-4435-aa50-4017e25a2f78 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:04.305379 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-bffd57a9-6f1e-4435-aa50-4017e25a2f78 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:04.331863 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-d7efb7a9-92a4-40f4-a492-84ff2fd0d93a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:04.331863 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-d7efb7a9-92a4-40f4-a492-84ff2fd0d93a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:04.335311 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d7efb7a9-92a4-40f4-a492-84ff2fd0d93a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:04.335823 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d7efb7a9-92a4-40f4-a492-84ff2fd0d93a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:04.336748 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d7efb7a9-92a4-40f4-a492-84ff2fd0d93a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:04.337343 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d7efb7a9-92a4-40f4-a492-84ff2fd0d93a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:06.802370 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-d7efb7a9-92a4-40f4-a492-84ff2fd0d93a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 28918 microversion: 2.1 time: 2.477700 Dec 16 15:51:06.803443 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 228/407] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:51:04 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 28918 bytes in 2480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 15:51:06.808483 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-8f6dd26d-a946-4b70-a621-9becd3790c19 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:06.809694 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-8f6dd26d-a946-4b70-a621-9becd3790c19 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:06.816470 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8f6dd26d-a946-4b70-a621-9becd3790c19 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:06.816930 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8f6dd26d-a946-4b70-a621-9becd3790c19 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:06.817849 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8f6dd26d-a946-4b70-a621-9becd3790c19 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:06.818204 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8f6dd26d-a946-4b70-a621-9becd3790c19 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:06.946273 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-bffd57a9-6f1e-4435-aa50-4017e25a2f78 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "POST /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.653620 Dec 16 15:51:06.951316 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 180/408] 10.222.0.31 () {60 vars in 1322 bytes} [Thu Dec 16 15:51:04 2021] POST /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91/os-volume_attachments => generated 194 bytes in 2659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:51:06.952353 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-8f6dd26d-a946-4b70-a621-9becd3790c19 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:06.960164 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-8f6dd26d-a946-4b70-a621-9becd3790c19 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0" status: 200 len: 1318 microversion: 2.1 time: 0.155341 Dec 16 15:51:06.961220 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 229/409] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:06 2021] GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:06.971605 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-c5be85f3-d475-4421-8bc6-801c6a6b512e req-c9ff486d-1e79-492c-833d-483c1c46942d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16cc9992-8538-4151-b169-681a3458fad0", "name": "network-vif-plugged", "status": "completed", "tag": "b6e9a2c2-ced6-4a5c-a5ae-564dd49086c3"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:06.973217 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:51:06.973217 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:51:06.981332 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-c5be85f3-d475-4421-8bc6-801c6a6b512e req-c9ff486d-1e79-492c-833d-483c1c46942d service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:06.981830 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-c5be85f3-d475-4421-8bc6-801c6a6b512e req-c9ff486d-1e79-492c-833d-483c1c46942d service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:06.992980 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-c5be85f3-d475-4421-8bc6-801c6a6b512e req-c9ff486d-1e79-492c-833d-483c1c46942d service nova] Creating event network-vif-plugged:b6e9a2c2-ced6-4a5c-a5ae-564dd49086c3 for instance 16cc9992-8538-4151-b169-681a3458fad0 on hv-cinder-78447 Dec 16 15:51:06.997914 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-c5be85f3-d475-4421-8bc6-801c6a6b512e req-c9ff486d-1e79-492c-833d-483c1c46942d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037761 Dec 16 15:51:06.998487 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 181/410] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:51:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:51:07.814247 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-a1fccf1b-dc02-4e3f-b59a-65a1dd4f9d04 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:07.815428 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-a1fccf1b-dc02-4e3f-b59a-65a1dd4f9d04 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:07.823408 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a1fccf1b-dc02-4e3f-b59a-65a1dd4f9d04 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:07.823958 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a1fccf1b-dc02-4e3f-b59a-65a1dd4f9d04 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:07.825288 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a1fccf1b-dc02-4e3f-b59a-65a1dd4f9d04 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:07.825909 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a1fccf1b-dc02-4e3f-b59a-65a1dd4f9d04 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:07.919462 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-a1fccf1b-dc02-4e3f-b59a-65a1dd4f9d04 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 29294 microversion: 2.1 time: 0.108846 Dec 16 15:51:07.920498 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 230/411] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:51:07 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 29294 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:51:07.978135 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-6782d54a-9ded-49ac-920f-f48c8ae96486 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:07.979734 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-6782d54a-9ded-49ac-920f-f48c8ae96486 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:07.988167 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6782d54a-9ded-49ac-920f-f48c8ae96486 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:07.988788 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6782d54a-9ded-49ac-920f-f48c8ae96486 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:07.989816 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6782d54a-9ded-49ac-920f-f48c8ae96486 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:07.990796 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6782d54a-9ded-49ac-920f-f48c8ae96486 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:08.172853 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-6782d54a-9ded-49ac-920f-f48c8ae96486 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:08.181966 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-6782d54a-9ded-49ac-920f-f48c8ae96486 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0" status: 200 len: 1318 microversion: 2.1 time: 0.208979 Dec 16 15:51:08.183466 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 182/412] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:07 2021] GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:08.937507 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-f9e14a0e-b186-4d8a-a66b-c72cd7b73d67 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:08.939421 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-f9e14a0e-b186-4d8a-a66b-c72cd7b73d67 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:08.946664 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f9e14a0e-b186-4d8a-a66b-c72cd7b73d67 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:08.947307 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f9e14a0e-b186-4d8a-a66b-c72cd7b73d67 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:08.948098 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f9e14a0e-b186-4d8a-a66b-c72cd7b73d67 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:08.948767 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f9e14a0e-b186-4d8a-a66b-c72cd7b73d67 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:09.199448 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-79549f15-7f32-4f10-92de-71b1dadedb42 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:09.199916 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-79549f15-7f32-4f10-92de-71b1dadedb42 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:09.209440 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-79549f15-7f32-4f10-92de-71b1dadedb42 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:09.210156 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-79549f15-7f32-4f10-92de-71b1dadedb42 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:09.212526 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-79549f15-7f32-4f10-92de-71b1dadedb42 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:09.213135 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-79549f15-7f32-4f10-92de-71b1dadedb42 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:09.350444 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-79549f15-7f32-4f10-92de-71b1dadedb42 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:09.360648 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-79549f15-7f32-4f10-92de-71b1dadedb42 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0" status: 200 len: 1318 microversion: 2.1 time: 0.164947 Dec 16 15:51:09.361211 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 183/413] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:09 2021] GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:10.379109 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-c6ec6fb5-5c99-480d-a22e-18139e390e78 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:10.379799 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-c6ec6fb5-5c99-480d-a22e-18139e390e78 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:10.385852 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c6ec6fb5-5c99-480d-a22e-18139e390e78 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:10.386610 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c6ec6fb5-5c99-480d-a22e-18139e390e78 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:10.387391 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c6ec6fb5-5c99-480d-a22e-18139e390e78 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:10.387813 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c6ec6fb5-5c99-480d-a22e-18139e390e78 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:10.647078 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-c6ec6fb5-5c99-480d-a22e-18139e390e78 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:10.654964 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-c6ec6fb5-5c99-480d-a22e-18139e390e78 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0" status: 200 len: 1318 microversion: 2.1 time: 0.280764 Dec 16 15:51:10.655624 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 184/414] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:10 2021] GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:11.222142 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-f9e14a0e-b186-4d8a-a66b-c72cd7b73d67 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 33373 microversion: 2.1 time: 2.291014 Dec 16 15:51:11.228562 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 231/415] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:51:08 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 33373 bytes in 2300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:51:11.671540 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-c5be0914-9994-4e6b-b239-13bad91a2266 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:11.672264 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-c5be0914-9994-4e6b-b239-13bad91a2266 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:11.678746 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c5be0914-9994-4e6b-b239-13bad91a2266 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:11.679190 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c5be0914-9994-4e6b-b239-13bad91a2266 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:11.679971 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c5be0914-9994-4e6b-b239-13bad91a2266 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:11.680402 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c5be0914-9994-4e6b-b239-13bad91a2266 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:12.149807 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-c5be0914-9994-4e6b-b239-13bad91a2266 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:12.170800 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-c5be0914-9994-4e6b-b239-13bad91a2266 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0" status: 200 len: 1508 microversion: 2.1 time: 0.503323 Dec 16 15:51:12.171436 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 185/416] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:11 2021] GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0 => generated 1508 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:12.238266 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-d19286f3-8abc-420c-8ecf-2ad3b8d2e969 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:12.239310 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-d19286f3-8abc-420c-8ecf-2ad3b8d2e969 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:12.256071 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d19286f3-8abc-420c-8ecf-2ad3b8d2e969 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:12.256520 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d19286f3-8abc-420c-8ecf-2ad3b8d2e969 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:12.259901 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d19286f3-8abc-420c-8ecf-2ad3b8d2e969 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:12.262225 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d19286f3-8abc-420c-8ecf-2ad3b8d2e969 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:12.361386 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-d19286f3-8abc-420c-8ecf-2ad3b8d2e969 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 33694 microversion: 2.1 time: 0.127455 Dec 16 15:51:12.363990 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 232/417] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:51:12 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 33694 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:51:13.374818 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-93f42f05-1238-4408-ae17-0ae1ee598eb6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:13.375853 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-93f42f05-1238-4408-ae17-0ae1ee598eb6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:13.382868 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-93f42f05-1238-4408-ae17-0ae1ee598eb6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:13.383548 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-93f42f05-1238-4408-ae17-0ae1ee598eb6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:13.385076 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-93f42f05-1238-4408-ae17-0ae1ee598eb6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:13.385739 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-93f42f05-1238-4408-ae17-0ae1ee598eb6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:13.482076 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-93f42f05-1238-4408-ae17-0ae1ee598eb6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 34002 microversion: 2.1 time: 0.107550 Dec 16 15:51:13.482076 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 186/418] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:51:13 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 34002 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:51:13.697222 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-85242564-6b3d-48e6-a807-3ea6489540f9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e238f17d-12ea-4fc3-84b6-7781aa1eabef"}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:13.698427 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-85242564-6b3d-48e6-a807-3ea6489540f9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:13.712340 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-85242564-6b3d-48e6-a807-3ea6489540f9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:13.713049 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-85242564-6b3d-48e6-a807-3ea6489540f9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:13.713831 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-85242564-6b3d-48e6-a807-3ea6489540f9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:13.714261 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-85242564-6b3d-48e6-a807-3ea6489540f9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:14.102502 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-85242564-6b3d-48e6-a807-3ea6489540f9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "POST /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.409348 Dec 16 15:51:14.103462 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 233/419] 10.222.0.31 () {60 vars in 1322 bytes} [Thu Dec 16 15:51:13 2021] POST /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0/os-volume_attachments => generated 194 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:51:14.492495 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-424c6f4a-7b51-4fbf-ac51-2052dff86aef tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:14.493639 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-424c6f4a-7b51-4fbf-ac51-2052dff86aef tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:14.504621 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-424c6f4a-7b51-4fbf-ac51-2052dff86aef tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:14.505020 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-424c6f4a-7b51-4fbf-ac51-2052dff86aef tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:14.505892 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-424c6f4a-7b51-4fbf-ac51-2052dff86aef tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:14.506338 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-424c6f4a-7b51-4fbf-ac51-2052dff86aef tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:14.607383 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-424c6f4a-7b51-4fbf-ac51-2052dff86aef tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 34443 microversion: 2.1 time: 0.118036 Dec 16 15:51:14.608629 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 187/420] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:51:14 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 34443 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:51:14.874310 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-c62a83de-ed2d-4d9e-a0b0-3bb68cc90e55 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:14.876380 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-c62a83de-ed2d-4d9e-a0b0-3bb68cc90e55 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:14.886764 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c62a83de-ed2d-4d9e-a0b0-3bb68cc90e55 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:14.887813 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c62a83de-ed2d-4d9e-a0b0-3bb68cc90e55 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:14.888967 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c62a83de-ed2d-4d9e-a0b0-3bb68cc90e55 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:14.889773 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c62a83de-ed2d-4d9e-a0b0-3bb68cc90e55 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:14.927463 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.objects.instance [None req-c62a83de-ed2d-4d9e-a0b0-3bb68cc90e55 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lazy-loading 'flavor' on Instance uuid 05750574-60a7-44f6-8fd6-d2fd52b57e91 {{(pid=122399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:51:15.165177 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-c62a83de-ed2d-4d9e-a0b0-3bb68cc90e55 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "POST /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91/action" status: 200 len: 32 microversion: 2.1 time: 0.296331 Dec 16 15:51:15.167819 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 234/421] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:51:14 2021] POST /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91/action => generated 32 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 16 15:51:15.183680 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-89464b12-0fd2-4edc-a5d8-be9192a27374 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:15.183680 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-89464b12-0fd2-4edc-a5d8-be9192a27374 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:15.195382 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-89464b12-0fd2-4edc-a5d8-be9192a27374 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:15.195833 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-89464b12-0fd2-4edc-a5d8-be9192a27374 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:15.200659 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-89464b12-0fd2-4edc-a5d8-be9192a27374 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:15.201471 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-89464b12-0fd2-4edc-a5d8-be9192a27374 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:15.466887 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-89464b12-0fd2-4edc-a5d8-be9192a27374 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:15.479983 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-89464b12-0fd2-4edc-a5d8-be9192a27374 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1568 microversion: 2.1 time: 0.307003 Dec 16 15:51:15.480710 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 188/422] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:15 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1568 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:15.622268 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-14696d20-f108-4a2f-a095-cda6350987b1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:15.623632 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-14696d20-f108-4a2f-a095-cda6350987b1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:15.633746 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-14696d20-f108-4a2f-a095-cda6350987b1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:15.634616 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-14696d20-f108-4a2f-a095-cda6350987b1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:15.637922 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-14696d20-f108-4a2f-a095-cda6350987b1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:15.640063 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-14696d20-f108-4a2f-a095-cda6350987b1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:15.776312 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-14696d20-f108-4a2f-a095-cda6350987b1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 35172 microversion: 2.1 time: 0.158433 Dec 16 15:51:15.777021 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 235/423] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:51:15 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 35172 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:51:16.498204 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-364b73db-2851-4a07-9b07-9f552885b7ce tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:16.498851 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-364b73db-2851-4a07-9b07-9f552885b7ce tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:16.505011 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-364b73db-2851-4a07-9b07-9f552885b7ce tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:16.511162 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-364b73db-2851-4a07-9b07-9f552885b7ce tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:16.512008 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-364b73db-2851-4a07-9b07-9f552885b7ce tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:16.512442 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-364b73db-2851-4a07-9b07-9f552885b7ce tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:16.790325 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-6495a3bd-4f87-463d-8ee8-6a804e602733 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:16.803602 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-6495a3bd-4f87-463d-8ee8-6a804e602733 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:16.814804 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-364b73db-2851-4a07-9b07-9f552885b7ce tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:16.826749 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6495a3bd-4f87-463d-8ee8-6a804e602733 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:16.827513 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-364b73db-2851-4a07-9b07-9f552885b7ce tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1568 microversion: 2.1 time: 0.333251 Dec 16 15:51:16.828482 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 189/424] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:16 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1568 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:16.840451 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6495a3bd-4f87-463d-8ee8-6a804e602733 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:16.842248 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6495a3bd-4f87-463d-8ee8-6a804e602733 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:16.843831 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6495a3bd-4f87-463d-8ee8-6a804e602733 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:16.954332 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-6495a3bd-4f87-463d-8ee8-6a804e602733 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 35805 microversion: 2.1 time: 0.168784 Dec 16 15:51:16.955953 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 236/425] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:51:16 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 35805 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:51:17.844948 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-dc200d44-a93b-4b87-b39e-d07042db4905 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:17.845608 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-dc200d44-a93b-4b87-b39e-d07042db4905 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:17.861351 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-dc200d44-a93b-4b87-b39e-d07042db4905 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:17.861904 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-dc200d44-a93b-4b87-b39e-d07042db4905 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:17.862871 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-dc200d44-a93b-4b87-b39e-d07042db4905 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:17.863506 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-dc200d44-a93b-4b87-b39e-d07042db4905 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:17.967420 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-5ff8b16f-b4ce-4025-b715-c291535512f0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:17.968583 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-5ff8b16f-b4ce-4025-b715-c291535512f0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:17.980002 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5ff8b16f-b4ce-4025-b715-c291535512f0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:17.983811 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5ff8b16f-b4ce-4025-b715-c291535512f0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:17.990641 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5ff8b16f-b4ce-4025-b715-c291535512f0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:17.991376 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5ff8b16f-b4ce-4025-b715-c291535512f0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:18.118270 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-5ff8b16f-b4ce-4025-b715-c291535512f0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 36841 microversion: 2.1 time: 0.155161 Dec 16 15:51:18.123717 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 237/426] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:51:17 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 36841 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 15:51:18.156820 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-dc200d44-a93b-4b87-b39e-d07042db4905 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:18.170538 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-dc200d44-a93b-4b87-b39e-d07042db4905 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1568 microversion: 2.1 time: 0.330074 Dec 16 15:51:18.172432 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 190/427] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:17 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1568 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:19.136726 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-2ceb0211-556a-4924-8128-1909394a7bd0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:19.138834 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-2ceb0211-556a-4924-8128-1909394a7bd0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:19.159396 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2ceb0211-556a-4924-8128-1909394a7bd0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:19.160413 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2ceb0211-556a-4924-8128-1909394a7bd0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:19.163536 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2ceb0211-556a-4924-8128-1909394a7bd0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:19.166106 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2ceb0211-556a-4924-8128-1909394a7bd0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:19.188029 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-84d1a90a-316d-4fb8-be7d-0f97fbe1606d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:19.189386 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-84d1a90a-316d-4fb8-be7d-0f97fbe1606d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:19.199352 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-84d1a90a-316d-4fb8-be7d-0f97fbe1606d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:19.203920 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-84d1a90a-316d-4fb8-be7d-0f97fbe1606d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:19.211373 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-84d1a90a-316d-4fb8-be7d-0f97fbe1606d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:19.215121 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-84d1a90a-316d-4fb8-be7d-0f97fbe1606d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:19.376235 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-2ceb0211-556a-4924-8128-1909394a7bd0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 37910 microversion: 2.1 time: 0.248504 Dec 16 15:51:19.376957 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 238/428] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:51:19 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 37910 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:51:19.906652 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-84d1a90a-316d-4fb8-be7d-0f97fbe1606d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:19.923315 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-84d1a90a-316d-4fb8-be7d-0f97fbe1606d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1568 microversion: 2.1 time: 0.739306 Dec 16 15:51:19.933214 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 191/429] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:19 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1568 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:20.389858 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-91ba55df-bbc8-4300-8ce0-8939872f9f55 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:20.390898 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-91ba55df-bbc8-4300-8ce0-8939872f9f55 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:20.406921 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-91ba55df-bbc8-4300-8ce0-8939872f9f55 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:20.408778 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-91ba55df-bbc8-4300-8ce0-8939872f9f55 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:20.412125 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-91ba55df-bbc8-4300-8ce0-8939872f9f55 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:20.425795 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-91ba55df-bbc8-4300-8ce0-8939872f9f55 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:20.577518 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-91ba55df-bbc8-4300-8ce0-8939872f9f55 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 38440 microversion: 2.1 time: 0.192232 Dec 16 15:51:20.578388 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 239/430] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:51:20 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 38440 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:51:20.940530 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-dfab2e04-d035-4215-8377-14e41e2fc01c tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:20.941241 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-dfab2e04-d035-4215-8377-14e41e2fc01c tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:20.955567 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-dfab2e04-d035-4215-8377-14e41e2fc01c tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:20.958169 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-dfab2e04-d035-4215-8377-14e41e2fc01c tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:20.970321 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-dfab2e04-d035-4215-8377-14e41e2fc01c tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:20.974171 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-dfab2e04-d035-4215-8377-14e41e2fc01c tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:21.300590 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-dfab2e04-d035-4215-8377-14e41e2fc01c tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:21.310673 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-dfab2e04-d035-4215-8377-14e41e2fc01c tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1568 microversion: 2.1 time: 0.374058 Dec 16 15:51:21.314470 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 192/431] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:20 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1568 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:21.591846 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-8deadcc7-6817-4e3c-a7ae-e1f21ca46d33 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:21.595729 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-8deadcc7-6817-4e3c-a7ae-e1f21ca46d33 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:21.607732 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8deadcc7-6817-4e3c-a7ae-e1f21ca46d33 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:21.608914 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8deadcc7-6817-4e3c-a7ae-e1f21ca46d33 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:21.610151 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8deadcc7-6817-4e3c-a7ae-e1f21ca46d33 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:21.611175 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8deadcc7-6817-4e3c-a7ae-e1f21ca46d33 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:21.723697 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-8deadcc7-6817-4e3c-a7ae-e1f21ca46d33 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 38440 microversion: 2.1 time: 0.130723 Dec 16 15:51:21.727800 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 240/432] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:51:21 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 38440 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:51:22.262803 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-892c4195-c4ea-4eea-a91b-64d6d9b900d2 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:22.263470 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-892c4195-c4ea-4eea-a91b-64d6d9b900d2 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:22.295207 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-892c4195-c4ea-4eea-a91b-64d6d9b900d2 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:22.296721 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-892c4195-c4ea-4eea-a91b-64d6d9b900d2 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:22.298751 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-892c4195-c4ea-4eea-a91b-64d6d9b900d2 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:22.299198 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-892c4195-c4ea-4eea-a91b-64d6d9b900d2 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:22.332638 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-33bde1a0-8b53-4f8f-9319-085561ddf3b2 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:22.333982 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-33bde1a0-8b53-4f8f-9319-085561ddf3b2 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:22.356233 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-33bde1a0-8b53-4f8f-9319-085561ddf3b2 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:22.358914 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-33bde1a0-8b53-4f8f-9319-085561ddf3b2 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:22.361122 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-33bde1a0-8b53-4f8f-9319-085561ddf3b2 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:22.361817 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-33bde1a0-8b53-4f8f-9319-085561ddf3b2 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:22.499097 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.objects.instance [None req-892c4195-c4ea-4eea-a91b-64d6d9b900d2 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lazy-loading 'services' on Instance uuid 16cc9992-8538-4151-b169-681a3458fad0 {{(pid=122398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:51:22.679375 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-892c4195-c4ea-4eea-a91b-64d6d9b900d2 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "DELETE /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0/os-volume_attachments/e238f17d-12ea-4fc3-84b6-7781aa1eabef" status: 202 len: 0 microversion: 2.1 time: 0.423048 Dec 16 15:51:22.683346 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 193/433] 10.222.0.31 () {58 vars in 1415 bytes} [Thu Dec 16 15:51:22 2021] DELETE /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0/os-volume_attachments/e238f17d-12ea-4fc3-84b6-7781aa1eabef => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:51:22.694897 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-a7fbb846-350e-4396-afbd-1915c81c8b90 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:22.699998 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-a7fbb846-350e-4396-afbd-1915c81c8b90 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:22.721956 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a7fbb846-350e-4396-afbd-1915c81c8b90 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:22.722661 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a7fbb846-350e-4396-afbd-1915c81c8b90 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:22.723747 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a7fbb846-350e-4396-afbd-1915c81c8b90 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:22.724335 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a7fbb846-350e-4396-afbd-1915c81c8b90 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:22.798236 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-a7fbb846-350e-4396-afbd-1915c81c8b90 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113653 Dec 16 15:51:22.799289 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 194/434] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Dec 16 15:51:22 2021] GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:51:22.811687 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-0778522d-a4c2-46fe-85ca-352fa2de426d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:22.812605 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-0778522d-a4c2-46fe-85ca-352fa2de426d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:22.833131 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0778522d-a4c2-46fe-85ca-352fa2de426d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:22.833615 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0778522d-a4c2-46fe-85ca-352fa2de426d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:22.834506 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0778522d-a4c2-46fe-85ca-352fa2de426d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:22.834968 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0778522d-a4c2-46fe-85ca-352fa2de426d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:22.949054 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-0778522d-a4c2-46fe-85ca-352fa2de426d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 200 len: 38570 microversion: 2.1 time: 0.145119 Dec 16 15:51:22.953461 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 195/435] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:51:22 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 38570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:51:22.965489 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-33bde1a0-8b53-4f8f-9319-085561ddf3b2 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:22.969918 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-f6011333-3031-4378-86b0-ddc0f31c1d28 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:22.970508 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-f6011333-3031-4378-86b0-ddc0f31c1d28 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:22.977150 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-33bde1a0-8b53-4f8f-9319-085561ddf3b2 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1568 microversion: 2.1 time: 0.650035 Dec 16 15:51:22.985362 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f6011333-3031-4378-86b0-ddc0f31c1d28 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:22.985844 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f6011333-3031-4378-86b0-ddc0f31c1d28 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:22.986676 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f6011333-3031-4378-86b0-ddc0f31c1d28 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:22.987089 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f6011333-3031-4378-86b0-ddc0f31c1d28 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:22.991234 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 241/436] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:22 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1568 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:23.034112 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-f6011333-3031-4378-86b0-ddc0f31c1d28 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/ips" status: 200 len: 145 microversion: 2.1 time: 0.074397 Dec 16 15:51:23.035022 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 196/437] 10.222.0.31 () {58 vars in 1247 bytes} [Thu Dec 16 15:51:22 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/ips => generated 145 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:51:23.561344 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-8272b921-4e95-445b-90b4-892c74230f49 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-935298982", "imageRef": "2a1434ad-0c2c-4725-baad-a605624baf01", "flavorRef": "452", "networks": [{"uuid": "eff1aea5-661c-4e32-824f-eec13ded2085"}]}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:23.639060 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.network.neutron [None req-8272b921-4e95-445b-90b4-892c74230f49 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] validate_networks() for [('eff1aea5-661c-4e32-824f-eec13ded2085', None, None, None, None, None)] {{(pid=122398) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 15:51:23.702993 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-07b90e10-72e5-4584-a066-a4458c25fba1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Action: 'create', calling method: .version_select at 0x7fed5e8ddb80>, body: {"keypair": {"name": "tempest-TestShelveInstance-1132735024"}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:23.729286 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-07b90e10-72e5-4584-a066-a4458c25fba1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Getting quotas for project 34de311402354bb6a5903e764e3a0cbc. Resources: {'key_pairs'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:51:23.737110 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-07b90e10-72e5-4584-a066-a4458c25fba1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Getting quotas for user 75f0340818bf4c5a94fa2ae5c4073625 and project 34de311402354bb6a5903e764e3a0cbc. Resources: {'key_pairs'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:51:24.104592 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-07b90e10-72e5-4584-a066-a4458c25fba1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Getting quotas for project 34de311402354bb6a5903e764e3a0cbc. Resources: {'key_pairs'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:51:24.120730 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-07b90e10-72e5-4584-a066-a4458c25fba1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Getting quotas for user 75f0340818bf4c5a94fa2ae5c4073625 and project 34de311402354bb6a5903e764e3a0cbc. Resources: {'key_pairs'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:51:24.138278 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-07b90e10-72e5-4584-a066-a4458c25fba1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.790970 Dec 16 15:51:24.139491 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 242/438] 10.222.0.31 () {60 vars in 1157 bytes} [Thu Dec 16 15:51:23 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:51:24.146021 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-5a567f3d-0241-4a47-9baa-45fc4a368ef5 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:24.147204 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-5a567f3d-0241-4a47-9baa-45fc4a368ef5 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:24.157962 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5a567f3d-0241-4a47-9baa-45fc4a368ef5 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:24.159507 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5a567f3d-0241-4a47-9baa-45fc4a368ef5 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:24.160567 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5a567f3d-0241-4a47-9baa-45fc4a368ef5 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:24.161317 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5a567f3d-0241-4a47-9baa-45fc4a368ef5 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:24.212698 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-8272b921-4e95-445b-90b4-892c74230f49 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Flavor limits 0:0:0 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 15:51:24.213376 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-8272b921-4e95-445b-90b4-892c74230f49 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Image limits 0:0:0 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 15:51:24.214023 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-8272b921-4e95-445b-90b4-892c74230f49 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Flavor pref 0:0:0 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 15:51:24.214586 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-8272b921-4e95-445b-90b4-892c74230f49 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Image pref 0:0:0 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 15:51:24.215033 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-8272b921-4e95-445b-90b4-892c74230f49 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 15:51:24.221782 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-5a567f3d-0241-4a47-9baa-45fc4a368ef5 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080962 Dec 16 15:51:24.222403 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 243/439] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Dec 16 15:51:24 2021] GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:51:24.226126 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8272b921-4e95-445b-90b4-892c74230f49 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:24.226763 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8272b921-4e95-445b-90b4-892c74230f49 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:24.227736 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-b9c56f05-2db0-49ff-a9e3-d7b62ed9f9c5 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:24.228259 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8272b921-4e95-445b-90b4-892c74230f49 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:24.228523 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-b9c56f05-2db0-49ff-a9e3-d7b62ed9f9c5 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:24.229532 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8272b921-4e95-445b-90b4-892c74230f49 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:24.245128 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b9c56f05-2db0-49ff-a9e3-d7b62ed9f9c5 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:24.245888 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b9c56f05-2db0-49ff-a9e3-d7b62ed9f9c5 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:24.246892 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b9c56f05-2db0-49ff-a9e3-d7b62ed9f9c5 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:24.247530 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b9c56f05-2db0-49ff-a9e3-d7b62ed9f9c5 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:24.264509 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.quota [None req-8272b921-4e95-445b-90b4-892c74230f49 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Getting quotas for project a7aae25eb2ad4219aff78b5f9150925f. Resources: {'instances', 'ram', 'cores'} {{(pid=122398) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:51:24.271809 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.quota [None req-8272b921-4e95-445b-90b4-892c74230f49 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Getting quotas for user 724c34ba12d8461fa8093c2f617f2755 and project a7aae25eb2ad4219aff78b5f9150925f. Resources: {'instances', 'ram', 'cores'} {{(pid=122398) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:51:24.294044 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-8272b921-4e95-445b-90b4-892c74230f49 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Going to run 1 instances... {{(pid=122398) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 15:51:24.296817 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-8272b921-4e95-445b-90b4-892c74230f49 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 0da3e1d4-06bf-46de-86eb-68d5f43ba5c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a1434ad-0c2c-4725-baad-a605624baf01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122398) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 15:51:24.413446 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-8272b921-4e95-445b-90b4-892c74230f49 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.859100 Dec 16 15:51:24.423275 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 197/440] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Dec 16 15:51:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 16 15:51:24.439778 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-31574dc7-98d3-4e32-8e42-fcf130ca3d01 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:24.440617 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-31574dc7-98d3-4e32-8e42-fcf130ca3d01 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 0da3e1d4-06bf-46de-86eb-68d5f43ba5c5] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:24.580237 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-31574dc7-98d3-4e32-8e42-fcf130ca3d01 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724c34ba12d8461fa8093c2f617f2755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7aae25eb2ad4219aff78b5f9150925f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:24.588872 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-31574dc7-98d3-4e32-8e42-fcf130ca3d01 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "GET /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5" status: 200 len: 1213 microversion: 2.1 time: 0.163332 Dec 16 15:51:24.591659 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 198/441] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:24 2021] GET /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5 => generated 1213 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:24.617725 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-b9c56f05-2db0-49ff-a9e3-d7b62ed9f9c5 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:24.630857 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-b9c56f05-2db0-49ff-a9e3-d7b62ed9f9c5 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1568 microversion: 2.1 time: 0.405891 Dec 16 15:51:24.632071 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 244/442] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:24 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1568 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:25.600095 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-ae3b547f-e518-437e-a51e-7fa6a2817c41 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:25.608565 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-03f33d4c-d85d-4750-8575-a7dc8c2d55a4 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:25.611053 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-03f33d4c-d85d-4750-8575-a7dc8c2d55a4 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 0da3e1d4-06bf-46de-86eb-68d5f43ba5c5] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:25.614895 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-ae3b547f-e518-437e-a51e-7fa6a2817c41 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:25.639337 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-03f33d4c-d85d-4750-8575-a7dc8c2d55a4 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:25.644440 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-03f33d4c-d85d-4750-8575-a7dc8c2d55a4 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:25.647690 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ae3b547f-e518-437e-a51e-7fa6a2817c41 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:25.648975 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-03f33d4c-d85d-4750-8575-a7dc8c2d55a4 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:25.649633 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ae3b547f-e518-437e-a51e-7fa6a2817c41 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:25.655361 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ae3b547f-e518-437e-a51e-7fa6a2817c41 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:25.657261 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-03f33d4c-d85d-4750-8575-a7dc8c2d55a4 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:25.661448 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ae3b547f-e518-437e-a51e-7fa6a2817c41 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:25.751650 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-ae3b547f-e518-437e-a51e-7fa6a2817c41 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Going to try to terminate instance {{(pid=122398) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 15:51:25.867930 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-03f33d4c-d85d-4750-8575-a7dc8c2d55a4 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724c34ba12d8461fa8093c2f617f2755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7aae25eb2ad4219aff78b5f9150925f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:25.878697 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-03f33d4c-d85d-4750-8575-a7dc8c2d55a4 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "GET /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5" status: 200 len: 1265 microversion: 2.1 time: 0.272771 Dec 16 15:51:25.889338 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 245/443] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:25 2021] GET /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5 => generated 1265 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:51:25.902254 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-add8a41f-85f0-4d1c-9aa8-0ca3e8078a1f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:25.902889 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-add8a41f-85f0-4d1c-9aa8-0ca3e8078a1f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:25.916853 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-add8a41f-85f0-4d1c-9aa8-0ca3e8078a1f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:25.917348 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-add8a41f-85f0-4d1c-9aa8-0ca3e8078a1f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:25.918261 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-add8a41f-85f0-4d1c-9aa8-0ca3e8078a1f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:25.918909 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-add8a41f-85f0-4d1c-9aa8-0ca3e8078a1f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:25.927526 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-ae3b547f-e518-437e-a51e-7fa6a2817c41 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "DELETE /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0" status: 204 len: 0 microversion: 2.1 time: 0.331918 Dec 16 15:51:25.928479 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 199/444] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Dec 16 15:51:25 2021] DELETE /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:51:25.944041 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-b12d0968-d29d-4a74-aa66-21d69e4b921e tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:25.945120 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-b12d0968-d29d-4a74-aa66-21d69e4b921e tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:25.961344 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b12d0968-d29d-4a74-aa66-21d69e4b921e tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:25.962192 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b12d0968-d29d-4a74-aa66-21d69e4b921e tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:25.964462 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b12d0968-d29d-4a74-aa66-21d69e4b921e tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:25.965063 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b12d0968-d29d-4a74-aa66-21d69e4b921e tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:26.333560 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-add8a41f-85f0-4d1c-9aa8-0ca3e8078a1f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:26.360639 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-add8a41f-85f0-4d1c-9aa8-0ca3e8078a1f tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1568 microversion: 2.1 time: 0.469429 Dec 16 15:51:26.370307 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 246/445] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:25 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1568 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:26.451893 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-b12d0968-d29d-4a74-aa66-21d69e4b921e tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:26.461227 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-b12d0968-d29d-4a74-aa66-21d69e4b921e tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0" status: 200 len: 1514 microversion: 2.1 time: 0.528543 Dec 16 15:51:26.466840 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 200/446] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:25 2021] GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0 => generated 1514 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:26.500293 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-7ef2cb10-02d4-4c2a-aa37-96d6b2c93de2 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac7d25b9-f2e8-4a8b-9bd2-530d487d53cb"}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:26.502847 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-7ef2cb10-02d4-4c2a-aa37-96d6b2c93de2 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:26.519810 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7ef2cb10-02d4-4c2a-aa37-96d6b2c93de2 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:26.520769 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7ef2cb10-02d4-4c2a-aa37-96d6b2c93de2 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:26.522982 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7ef2cb10-02d4-4c2a-aa37-96d6b2c93de2 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:26.524395 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7ef2cb10-02d4-4c2a-aa37-96d6b2c93de2 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:26.895699 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-d3654ec5-dfc9-469a-a5b4-bf28e6a35a1d tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:26.896419 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-d3654ec5-dfc9-469a-a5b4-bf28e6a35a1d tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 0da3e1d4-06bf-46de-86eb-68d5f43ba5c5] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:26.910019 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d3654ec5-dfc9-469a-a5b4-bf28e6a35a1d tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:26.910465 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d3654ec5-dfc9-469a-a5b4-bf28e6a35a1d tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:26.911293 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d3654ec5-dfc9-469a-a5b4-bf28e6a35a1d tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:26.918791 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d3654ec5-dfc9-469a-a5b4-bf28e6a35a1d tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:27.031992 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-7ef2cb10-02d4-4c2a-aa37-96d6b2c93de2 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.535755 Dec 16 15:51:27.045142 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 247/447] 10.222.0.31 () {60 vars in 1322 bytes} [Thu Dec 16 15:51:26 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/os-volume_attachments => generated 194 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:51:27.149304 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-d3654ec5-dfc9-469a-a5b4-bf28e6a35a1d tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724c34ba12d8461fa8093c2f617f2755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7aae25eb2ad4219aff78b5f9150925f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:27.158482 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-d3654ec5-dfc9-469a-a5b4-bf28e6a35a1d tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "GET /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5" status: 200 len: 1271 microversion: 2.1 time: 0.267614 Dec 16 15:51:27.163639 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 201/448] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:26 2021] GET /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5 => generated 1271 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:51:27.387433 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-7994dc16-6a25-42b8-afa9-b4a897bd7eac tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:27.388143 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-7994dc16-6a25-42b8-afa9-b4a897bd7eac tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:27.403758 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7994dc16-6a25-42b8-afa9-b4a897bd7eac tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:27.404643 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7994dc16-6a25-42b8-afa9-b4a897bd7eac tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:27.405984 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7994dc16-6a25-42b8-afa9-b4a897bd7eac tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:27.406664 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7994dc16-6a25-42b8-afa9-b4a897bd7eac tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:27.498273 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-ef853e70-4a83-4fef-be3e-ce3fed9c4763 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:27.499172 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-ef853e70-4a83-4fef-be3e-ce3fed9c4763 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:27.518295 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ef853e70-4a83-4fef-be3e-ce3fed9c4763 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:27.518660 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ef853e70-4a83-4fef-be3e-ce3fed9c4763 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:27.519491 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ef853e70-4a83-4fef-be3e-ce3fed9c4763 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:27.520058 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ef853e70-4a83-4fef-be3e-ce3fed9c4763 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:27.765158 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-7994dc16-6a25-42b8-afa9-b4a897bd7eac tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:27.779488 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-7994dc16-6a25-42b8-afa9-b4a897bd7eac tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1568 microversion: 2.1 time: 0.396452 Dec 16 15:51:27.780097 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 248/449] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:27 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1568 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:27.878044 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-ef853e70-4a83-4fef-be3e-ce3fed9c4763 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:27.888115 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-ef853e70-4a83-4fef-be3e-ce3fed9c4763 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0" status: 200 len: 1514 microversion: 2.1 time: 0.399005 Dec 16 15:51:27.889322 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 202/450] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:27 2021] GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0 => generated 1514 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:28.180670 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-853dc079-a913-4001-924d-0f3356f29f50 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:28.181569 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-853dc079-a913-4001-924d-0f3356f29f50 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 0da3e1d4-06bf-46de-86eb-68d5f43ba5c5] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:28.218127 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-853dc079-a913-4001-924d-0f3356f29f50 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:28.218883 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-853dc079-a913-4001-924d-0f3356f29f50 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:28.219880 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-853dc079-a913-4001-924d-0f3356f29f50 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:28.220826 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-853dc079-a913-4001-924d-0f3356f29f50 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:28.510037 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-853dc079-a913-4001-924d-0f3356f29f50 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724c34ba12d8461fa8093c2f617f2755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7aae25eb2ad4219aff78b5f9150925f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:28.535750 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-853dc079-a913-4001-924d-0f3356f29f50 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "GET /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5" status: 200 len: 1313 microversion: 2.1 time: 0.358830 Dec 16 15:51:28.537187 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 249/451] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:28 2021] GET /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5 => generated 1313 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:28.798966 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-a46bc347-26b0-4dd4-92cd-ac3aaa94c6d5 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:28.801329 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-a46bc347-26b0-4dd4-92cd-ac3aaa94c6d5 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:28.814250 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a46bc347-26b0-4dd4-92cd-ac3aaa94c6d5 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:28.814991 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a46bc347-26b0-4dd4-92cd-ac3aaa94c6d5 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:28.816086 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a46bc347-26b0-4dd4-92cd-ac3aaa94c6d5 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:28.816880 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a46bc347-26b0-4dd4-92cd-ac3aaa94c6d5 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:28.904631 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-d97b242d-3767-451e-844d-1006fbd5ceb5 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:28.905519 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-d97b242d-3767-451e-844d-1006fbd5ceb5 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:28.925454 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d97b242d-3767-451e-844d-1006fbd5ceb5 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:28.925916 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d97b242d-3767-451e-844d-1006fbd5ceb5 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:28.928894 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d97b242d-3767-451e-844d-1006fbd5ceb5 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:28.929359 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d97b242d-3767-451e-844d-1006fbd5ceb5 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:29.287489 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-a46bc347-26b0-4dd4-92cd-ac3aaa94c6d5 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:29.307367 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-d97b242d-3767-451e-844d-1006fbd5ceb5 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:29.317104 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-d97b242d-3767-451e-844d-1006fbd5ceb5 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0" status: 200 len: 1514 microversion: 2.1 time: 0.416744 Dec 16 15:51:29.317882 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-a46bc347-26b0-4dd4-92cd-ac3aaa94c6d5 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1568 microversion: 2.1 time: 0.523869 Dec 16 15:51:29.320934 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 203/452] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:28 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1568 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:29.321608 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 250/453] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:28 2021] GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0 => generated 1514 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:51:29.551933 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-cc7dbe3c-c93b-4a82-830a-aa2575ae575c tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:29.552702 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-cc7dbe3c-c93b-4a82-830a-aa2575ae575c tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 0da3e1d4-06bf-46de-86eb-68d5f43ba5c5] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:29.560343 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cc7dbe3c-c93b-4a82-830a-aa2575ae575c tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:29.561035 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cc7dbe3c-c93b-4a82-830a-aa2575ae575c tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:29.562164 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cc7dbe3c-c93b-4a82-830a-aa2575ae575c tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:29.562976 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cc7dbe3c-c93b-4a82-830a-aa2575ae575c tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:29.673719 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-e3a973df-5d22-458f-a992-43adeeb834e4 req-65c22dc6-411c-438c-9431-c3df13563e85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16cc9992-8538-4151-b169-681a3458fad0", "name": "network-vif-deleted", "tag": "b6e9a2c2-ced6-4a5c-a5ae-564dd49086c3"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:29.678659 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:51:29.678659 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:51:29.689425 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-e3a973df-5d22-458f-a992-43adeeb834e4 req-65c22dc6-411c-438c-9431-c3df13563e85 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:29.691145 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-e3a973df-5d22-458f-a992-43adeeb834e4 req-65c22dc6-411c-438c-9431-c3df13563e85 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:29.708680 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-e3a973df-5d22-458f-a992-43adeeb834e4 req-65c22dc6-411c-438c-9431-c3df13563e85 service nova] Creating event network-vif-deleted:b6e9a2c2-ced6-4a5c-a5ae-564dd49086c3 for instance 16cc9992-8538-4151-b169-681a3458fad0 on hv-cinder-78447 Dec 16 15:51:29.714823 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-e3a973df-5d22-458f-a992-43adeeb834e4 req-65c22dc6-411c-438c-9431-c3df13563e85 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045828 Dec 16 15:51:29.716696 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 251/454] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:51:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:51:29.933858 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-cc7dbe3c-c93b-4a82-830a-aa2575ae575c tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724c34ba12d8461fa8093c2f617f2755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7aae25eb2ad4219aff78b5f9150925f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:29.941071 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-cc7dbe3c-c93b-4a82-830a-aa2575ae575c tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "GET /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5" status: 200 len: 1313 microversion: 2.1 time: 0.392839 Dec 16 15:51:29.941671 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 204/455] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:29 2021] GET /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5 => generated 1313 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:30.337286 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-1103ee5a-eccf-436b-a2d6-8361842b6ae3 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:30.364935 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-1103ee5a-eccf-436b-a2d6-8361842b6ae3 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 16cc9992-8538-4151-b169-681a3458fad0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:30.365938 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-7b8170be-44f2-44fa-b477-688588b24f96 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:30.369596 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-7b8170be-44f2-44fa-b477-688588b24f96 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:30.384412 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1103ee5a-eccf-436b-a2d6-8361842b6ae3 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:30.385938 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1103ee5a-eccf-436b-a2d6-8361842b6ae3 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:30.388430 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7b8170be-44f2-44fa-b477-688588b24f96 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:30.391044 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1103ee5a-eccf-436b-a2d6-8361842b6ae3 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:30.391707 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1103ee5a-eccf-436b-a2d6-8361842b6ae3 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:30.393660 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7b8170be-44f2-44fa-b477-688588b24f96 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:30.394767 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7b8170be-44f2-44fa-b477-688588b24f96 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:30.399164 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7b8170be-44f2-44fa-b477-688588b24f96 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:30.429814 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.wsgi [None req-1103ee5a-eccf-436b-a2d6-8361842b6ae3 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] HTTP exception thrown: Instance 16cc9992-8538-4151-b169-681a3458fad0 could not be found. Dec 16 15:51:30.430754 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-1103ee5a-eccf-436b-a2d6-8361842b6ae3 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Returning 404 to user: Instance 16cc9992-8538-4151-b169-681a3458fad0 could not be found. {{(pid=122398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:51:30.431906 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-1103ee5a-eccf-436b-a2d6-8361842b6ae3 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0" status: 404 len: 111 microversion: 2.1 time: 0.098561 Dec 16 15:51:30.435948 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 205/456] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:30 2021] GET /compute/v2.1/servers/16cc9992-8538-4151-b169-681a3458fad0 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:51:30.742908 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-7b8170be-44f2-44fa-b477-688588b24f96 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:30.752618 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-7b8170be-44f2-44fa-b477-688588b24f96 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1568 microversion: 2.1 time: 0.420621 Dec 16 15:51:30.753190 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 252/457] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:30 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1568 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:30.958281 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-99c1963b-c47d-4fba-885e-e287970ef82e tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:30.958992 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-99c1963b-c47d-4fba-885e-e287970ef82e tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 0da3e1d4-06bf-46de-86eb-68d5f43ba5c5] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:30.965396 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-99c1963b-c47d-4fba-885e-e287970ef82e tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:30.965860 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-99c1963b-c47d-4fba-885e-e287970ef82e tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:30.966824 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-99c1963b-c47d-4fba-885e-e287970ef82e tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:30.967252 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-99c1963b-c47d-4fba-885e-e287970ef82e tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:31.230204 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-99c1963b-c47d-4fba-885e-e287970ef82e tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724c34ba12d8461fa8093c2f617f2755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7aae25eb2ad4219aff78b5f9150925f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:31.238875 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-99c1963b-c47d-4fba-885e-e287970ef82e tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "GET /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5" status: 200 len: 1313 microversion: 2.1 time: 0.284758 Dec 16 15:51:31.247270 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 206/458] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:30 2021] GET /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5 => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:31.589819 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-715f3ace-8096-448d-8a3c-328f8448f127 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:31.590986 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-715f3ace-8096-448d-8a3c-328f8448f127 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:31.599049 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-715f3ace-8096-448d-8a3c-328f8448f127 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:31.599811 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-715f3ace-8096-448d-8a3c-328f8448f127 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:31.600621 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-715f3ace-8096-448d-8a3c-328f8448f127 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:31.601048 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-715f3ace-8096-448d-8a3c-328f8448f127 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:31.629097 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-715f3ace-8096-448d-8a3c-328f8448f127 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4] Going to try to terminate instance {{(pid=122399) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 15:51:31.738721 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-715f3ace-8096-448d-8a3c-328f8448f127 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "DELETE /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4" status: 204 len: 0 microversion: 2.1 time: 0.151119 Dec 16 15:51:31.744847 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-79e0e450-f58e-421e-ab18-527411fdafa6 req-79014616-4d8d-43b3-a9a3-1f824f8778f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0da3e1d4-06bf-46de-86eb-68d5f43ba5c5", "tag": "984dabc2-cade-4581-ad2d-f7a02987fca5"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:31.746732 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 253/459] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Dec 16 15:51:31 2021] DELETE /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:51:31.747994 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:51:31.747994 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:51:31.755760 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-79e0e450-f58e-421e-ab18-527411fdafa6 req-79014616-4d8d-43b3-a9a3-1f824f8778f8 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:31.756201 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-79e0e450-f58e-421e-ab18-527411fdafa6 req-79014616-4d8d-43b3-a9a3-1f824f8778f8 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:31.757954 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-1dc2e748-cfc0-44c8-b1dc-84139a1b9f97 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:31.758853 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-1dc2e748-cfc0-44c8-b1dc-84139a1b9f97 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:31.766984 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1dc2e748-cfc0-44c8-b1dc-84139a1b9f97 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:31.767846 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1dc2e748-cfc0-44c8-b1dc-84139a1b9f97 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:31.768855 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1dc2e748-cfc0-44c8-b1dc-84139a1b9f97 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:31.769446 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1dc2e748-cfc0-44c8-b1dc-84139a1b9f97 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:31.774676 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-79e0e450-f58e-421e-ab18-527411fdafa6 req-79014616-4d8d-43b3-a9a3-1f824f8778f8 service nova] Creating event network-changed:984dabc2-cade-4581-ad2d-f7a02987fca5 for instance 0da3e1d4-06bf-46de-86eb-68d5f43ba5c5 on hv-cinder-78447 Dec 16 15:51:31.796484 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-79e0e450-f58e-421e-ab18-527411fdafa6 req-79014616-4d8d-43b3-a9a3-1f824f8778f8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055381 Dec 16 15:51:31.801089 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 207/460] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:51:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:51:31.811960 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-2242227a-837d-4717-8258-88f67ef3cd63 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:31.812679 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-2242227a-837d-4717-8258-88f67ef3cd63 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:31.819759 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2242227a-837d-4717-8258-88f67ef3cd63 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:31.820170 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2242227a-837d-4717-8258-88f67ef3cd63 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:31.821206 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2242227a-837d-4717-8258-88f67ef3cd63 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:31.821845 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2242227a-837d-4717-8258-88f67ef3cd63 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:32.434144 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-1dc2e748-cfc0-44c8-b1dc-84139a1b9f97 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:32.442658 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-1dc2e748-cfc0-44c8-b1dc-84139a1b9f97 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4" status: 200 len: 1515 microversion: 2.1 time: 0.691462 Dec 16 15:51:32.443262 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 254/461] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:31 2021] GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4 => generated 1515 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:51:32.457621 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-b4996fe2-34bb-411e-9f75-cc69da0742bf tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:32.458257 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-b4996fe2-34bb-411e-9f75-cc69da0742bf tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 0da3e1d4-06bf-46de-86eb-68d5f43ba5c5] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:32.472406 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b4996fe2-34bb-411e-9f75-cc69da0742bf tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:32.472872 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b4996fe2-34bb-411e-9f75-cc69da0742bf tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:32.473739 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b4996fe2-34bb-411e-9f75-cc69da0742bf tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:32.474346 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b4996fe2-34bb-411e-9f75-cc69da0742bf tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:32.614044 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-2242227a-837d-4717-8258-88f67ef3cd63 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:32.623167 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-2242227a-837d-4717-8258-88f67ef3cd63 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1568 microversion: 2.1 time: 0.820551 Dec 16 15:51:32.623761 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 208/462] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:31 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1568 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:32.790936 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-b4996fe2-34bb-411e-9f75-cc69da0742bf tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724c34ba12d8461fa8093c2f617f2755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7aae25eb2ad4219aff78b5f9150925f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:32.800665 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-b4996fe2-34bb-411e-9f75-cc69da0742bf tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "GET /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5" status: 200 len: 1313 microversion: 2.1 time: 0.346851 Dec 16 15:51:32.801737 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 255/463] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:32 2021] GET /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5 => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:33.463396 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-3c900ce1-6105-419e-963c-1241fe482240 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:33.464193 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-3c900ce1-6105-419e-963c-1241fe482240 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:33.475272 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3c900ce1-6105-419e-963c-1241fe482240 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:33.476093 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3c900ce1-6105-419e-963c-1241fe482240 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:33.477107 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3c900ce1-6105-419e-963c-1241fe482240 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:33.477725 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3c900ce1-6105-419e-963c-1241fe482240 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:33.641633 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-f14fa872-771c-4c94-bc88-2b129873a530 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:33.642582 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-f14fa872-771c-4c94-bc88-2b129873a530 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:33.651767 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f14fa872-771c-4c94-bc88-2b129873a530 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:33.652560 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f14fa872-771c-4c94-bc88-2b129873a530 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:33.653629 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f14fa872-771c-4c94-bc88-2b129873a530 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:33.654267 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f14fa872-771c-4c94-bc88-2b129873a530 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:34.027831 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-3c900ce1-6105-419e-963c-1241fe482240 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:34.036903 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-3c900ce1-6105-419e-963c-1241fe482240 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4" status: 200 len: 1515 microversion: 2.1 time: 0.580205 Dec 16 15:51:34.042451 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 209/464] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:33 2021] GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4 => generated 1515 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:34.054186 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-8820c00e-5fb3-4823-967f-fd49e741a255 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:34.058200 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-8820c00e-5fb3-4823-967f-fd49e741a255 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 0da3e1d4-06bf-46de-86eb-68d5f43ba5c5] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:34.075477 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8820c00e-5fb3-4823-967f-fd49e741a255 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:34.076342 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8820c00e-5fb3-4823-967f-fd49e741a255 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:34.077393 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8820c00e-5fb3-4823-967f-fd49e741a255 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:34.078074 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8820c00e-5fb3-4823-967f-fd49e741a255 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:34.205572 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-f14fa872-771c-4c94-bc88-2b129873a530 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:34.222600 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-f14fa872-771c-4c94-bc88-2b129873a530 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1568 microversion: 2.1 time: 0.584562 Dec 16 15:51:34.223469 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 256/465] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:33 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1568 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:51:34.413138 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-8820c00e-5fb3-4823-967f-fd49e741a255 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724c34ba12d8461fa8093c2f617f2755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7aae25eb2ad4219aff78b5f9150925f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:34.426558 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-8820c00e-5fb3-4823-967f-fd49e741a255 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "GET /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5" status: 200 len: 1313 microversion: 2.1 time: 0.381130 Dec 16 15:51:34.428943 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 210/466] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:34 2021] GET /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5 => generated 1313 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:34.596785 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-09c71617-76e0-4c02-a2a7-acac1f9ce950 req-6342847a-333d-4ed1-bb13-4fcc555604d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f1cffca-44cf-40b7-9216-7d78fdbef5b4", "name": "network-vif-deleted", "tag": "eb7f3056-2f47-436e-8398-5620ee86da73"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:34.599170 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:51:34.599170 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:51:34.617546 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-09c71617-76e0-4c02-a2a7-acac1f9ce950 req-6342847a-333d-4ed1-bb13-4fcc555604d1 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:34.617982 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-09c71617-76e0-4c02-a2a7-acac1f9ce950 req-6342847a-333d-4ed1-bb13-4fcc555604d1 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:34.648026 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-09c71617-76e0-4c02-a2a7-acac1f9ce950 req-6342847a-333d-4ed1-bb13-4fcc555604d1 service nova] Creating event network-vif-deleted:eb7f3056-2f47-436e-8398-5620ee86da73 for instance 4f1cffca-44cf-40b7-9216-7d78fdbef5b4 on hv-cinder-78447 Dec 16 15:51:34.653123 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-09c71617-76e0-4c02-a2a7-acac1f9ce950 req-6342847a-333d-4ed1-bb13-4fcc555604d1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060608 Dec 16 15:51:34.653768 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 257/467] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:51:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:51:34.832470 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-db6355e1-98b9-40cb-ae4a-6f9e201cac11 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:34.842701 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-db6355e1-98b9-40cb-ae4a-6f9e201cac11 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:34.843805 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-db6355e1-98b9-40cb-ae4a-6f9e201cac11 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:35.006826 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-db6355e1-98b9-40cb-ae4a-6f9e201cac11 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Going to try to stop instance {{(pid=122398) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 16 15:51:35.065457 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-eea74918-c017-4fd3-a139-10d320a4f6a9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:35.066938 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-eea74918-c017-4fd3-a139-10d320a4f6a9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:35.086794 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-eea74918-c017-4fd3-a139-10d320a4f6a9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:35.089640 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-eea74918-c017-4fd3-a139-10d320a4f6a9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:35.096962 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-eea74918-c017-4fd3-a139-10d320a4f6a9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:35.101818 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-eea74918-c017-4fd3-a139-10d320a4f6a9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:35.131375 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-db6355e1-98b9-40cb-ae4a-6f9e201cac11 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 202 len: 0 microversion: 2.1 time: 0.303605 Dec 16 15:51:35.133776 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 211/468] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:51:34 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:51:35.155111 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-f5270c04-c01a-48bf-89e3-928f01562c0a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:35.157494 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-f5270c04-c01a-48bf-89e3-928f01562c0a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:35.169504 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f5270c04-c01a-48bf-89e3-928f01562c0a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:35.178970 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f5270c04-c01a-48bf-89e3-928f01562c0a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:35.180806 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f5270c04-c01a-48bf-89e3-928f01562c0a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:35.181735 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f5270c04-c01a-48bf-89e3-928f01562c0a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:35.251198 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-eea74918-c017-4fd3-a139-10d320a4f6a9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:35.252362 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-eea74918-c017-4fd3-a139-10d320a4f6a9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:35.253036 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.objects.instance [None req-eea74918-c017-4fd3-a139-10d320a4f6a9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lazy-loading 'fault' on Instance uuid 4f1cffca-44cf-40b7-9216-7d78fdbef5b4 {{(pid=122399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:51:35.397734 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-eea74918-c017-4fd3-a139-10d320a4f6a9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:35.406523 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-eea74918-c017-4fd3-a139-10d320a4f6a9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4" status: 200 len: 1308 microversion: 2.1 time: 0.346964 Dec 16 15:51:35.407472 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 258/469] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:35 2021] GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4 => generated 1308 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:35.412329 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-c1b87246-de9f-4015-9e5a-f312dfad3a90 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:35.413240 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-c1b87246-de9f-4015-9e5a-f312dfad3a90 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:35.420330 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c1b87246-de9f-4015-9e5a-f312dfad3a90 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:35.421094 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c1b87246-de9f-4015-9e5a-f312dfad3a90 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:35.422164 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c1b87246-de9f-4015-9e5a-f312dfad3a90 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:35.422998 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c1b87246-de9f-4015-9e5a-f312dfad3a90 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:35.536222 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-f5270c04-c01a-48bf-89e3-928f01562c0a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:35.546642 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-f5270c04-c01a-48bf-89e3-928f01562c0a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1721 microversion: 2.1 time: 0.407693 Dec 16 15:51:35.547910 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 212/470] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:35 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1721 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:35.552880 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-58312af5-789d-43d2-99ac-92136c42ca8e tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:35.553989 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-58312af5-789d-43d2-99ac-92136c42ca8e tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 0da3e1d4-06bf-46de-86eb-68d5f43ba5c5] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:35.562010 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-58312af5-789d-43d2-99ac-92136c42ca8e tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:35.562655 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-58312af5-789d-43d2-99ac-92136c42ca8e tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:35.564158 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-58312af5-789d-43d2-99ac-92136c42ca8e tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:35.564589 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-58312af5-789d-43d2-99ac-92136c42ca8e tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:35.648763 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-c1b87246-de9f-4015-9e5a-f312dfad3a90 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:35.657903 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-c1b87246-de9f-4015-9e5a-f312dfad3a90 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1568 microversion: 2.1 time: 0.249043 Dec 16 15:51:35.659290 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 259/471] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:35 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1568 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:35.743397 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-58312af5-789d-43d2-99ac-92136c42ca8e tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724c34ba12d8461fa8093c2f617f2755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7aae25eb2ad4219aff78b5f9150925f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:35.751323 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-58312af5-789d-43d2-99ac-92136c42ca8e tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "GET /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5" status: 200 len: 1313 microversion: 2.1 time: 0.202073 Dec 16 15:51:35.752615 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 213/472] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:35 2021] GET /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:35.879265 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-010d5c9e-533b-4ac8-babf-b8b0e1c9016a tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Action: 'create', calling method: .version_select at 0x7fed5e86b940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-824262971"}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:35.893032 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-010d5c9e-533b-4ac8-babf-b8b0e1c9016a tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Getting quotas for project 5afea3407ef84fafa658a82512fb4d24. Resources: {'key_pairs'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:51:35.897566 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-010d5c9e-533b-4ac8-babf-b8b0e1c9016a tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Getting quotas for user 92fd364ddd594b9eb5fe5ffad72ac32e and project 5afea3407ef84fafa658a82512fb4d24. Resources: {'key_pairs'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:51:36.177953 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-010d5c9e-533b-4ac8-babf-b8b0e1c9016a tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Getting quotas for project 5afea3407ef84fafa658a82512fb4d24. Resources: {'key_pairs'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:51:36.182657 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-010d5c9e-533b-4ac8-babf-b8b0e1c9016a tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Getting quotas for user 92fd364ddd594b9eb5fe5ffad72ac32e and project 5afea3407ef84fafa658a82512fb4d24. Resources: {'key_pairs'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:51:36.197535 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-010d5c9e-533b-4ac8-babf-b8b0e1c9016a tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.536542 Dec 16 15:51:36.198242 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 260/473] 10.222.0.31 () {60 vars in 1157 bytes} [Thu Dec 16 15:51:35 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:36.431336 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-adfc88e1-ff40-422a-8ebd-5725ed2cb540 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:36.432530 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-adfc88e1-ff40-422a-8ebd-5725ed2cb540 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 4f1cffca-44cf-40b7-9216-7d78fdbef5b4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:36.454475 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-adfc88e1-ff40-422a-8ebd-5725ed2cb540 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:36.455193 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-adfc88e1-ff40-422a-8ebd-5725ed2cb540 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:36.456157 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-adfc88e1-ff40-422a-8ebd-5725ed2cb540 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:36.456738 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-adfc88e1-ff40-422a-8ebd-5725ed2cb540 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:36.473734 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.wsgi [None req-adfc88e1-ff40-422a-8ebd-5725ed2cb540 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] HTTP exception thrown: Instance 4f1cffca-44cf-40b7-9216-7d78fdbef5b4 could not be found. Dec 16 15:51:36.475276 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-adfc88e1-ff40-422a-8ebd-5725ed2cb540 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Returning 404 to user: Instance 4f1cffca-44cf-40b7-9216-7d78fdbef5b4 could not be found. {{(pid=122398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:51:36.476262 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-adfc88e1-ff40-422a-8ebd-5725ed2cb540 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4" status: 404 len: 111 microversion: 2.1 time: 0.053042 Dec 16 15:51:36.477693 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 214/474] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:36 2021] GET /compute/v2.1/servers/4f1cffca-44cf-40b7-9216-7d78fdbef5b4 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 16 15:51:36.486603 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-9d4bef2a-8292-460d-a92f-8d45d7de3cc3 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:36.487139 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-9d4bef2a-8292-460d-a92f-8d45d7de3cc3 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 07a50ac4-a4f8-411a-9457-cd592eab7e7c] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:36.494777 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9d4bef2a-8292-460d-a92f-8d45d7de3cc3 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:36.495519 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9d4bef2a-8292-460d-a92f-8d45d7de3cc3 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:36.496547 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9d4bef2a-8292-460d-a92f-8d45d7de3cc3 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:36.497043 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9d4bef2a-8292-460d-a92f-8d45d7de3cc3 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:36.532031 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-9d4bef2a-8292-460d-a92f-8d45d7de3cc3 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 07a50ac4-a4f8-411a-9457-cd592eab7e7c] Going to try to terminate instance {{(pid=122399) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 15:51:36.564186 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-3a265317-058c-4150-b0d6-8f170449669c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:36.565171 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-3a265317-058c-4150-b0d6-8f170449669c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:36.582931 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3a265317-058c-4150-b0d6-8f170449669c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:36.585888 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3a265317-058c-4150-b0d6-8f170449669c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:36.586796 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3a265317-058c-4150-b0d6-8f170449669c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:36.589066 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3a265317-058c-4150-b0d6-8f170449669c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:36.693597 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-9d4bef2a-8292-460d-a92f-8d45d7de3cc3 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "DELETE /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c" status: 204 len: 0 microversion: 2.1 time: 0.211039 Dec 16 15:51:36.695040 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 261/475] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Dec 16 15:51:36 2021] DELETE /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:51:36.703575 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-fc333ae8-4e02-498b-9f9b-0c139285edc3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:36.704886 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-fc333ae8-4e02-498b-9f9b-0c139285edc3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:36.719738 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-fc333ae8-4e02-498b-9f9b-0c139285edc3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:36.720395 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-fc333ae8-4e02-498b-9f9b-0c139285edc3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:36.721780 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-fc333ae8-4e02-498b-9f9b-0c139285edc3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:36.722582 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-fc333ae8-4e02-498b-9f9b-0c139285edc3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:36.902838 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-3a265317-058c-4150-b0d6-8f170449669c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:36.912707 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-3a265317-058c-4150-b0d6-8f170449669c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1721 microversion: 2.1 time: 0.352225 Dec 16 15:51:36.913921 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 215/476] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:36 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1721 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:36.918732 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-83d6aad1-0927-4d29-b335-ce3094ce20ec tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:36.919929 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-83d6aad1-0927-4d29-b335-ce3094ce20ec tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 07a50ac4-a4f8-411a-9457-cd592eab7e7c] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:36.928270 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-83d6aad1-0927-4d29-b335-ce3094ce20ec tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:36.929024 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-83d6aad1-0927-4d29-b335-ce3094ce20ec tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:36.930522 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-83d6aad1-0927-4d29-b335-ce3094ce20ec tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:36.931044 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-83d6aad1-0927-4d29-b335-ce3094ce20ec tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:36.993210 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-fc333ae8-4e02-498b-9f9b-0c139285edc3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:37.001980 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-fc333ae8-4e02-498b-9f9b-0c139285edc3 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1568 microversion: 2.1 time: 0.304519 Dec 16 15:51:37.002712 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 262/477] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:36 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1568 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:37.007156 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-d54f89fa-14c0-412a-a8de-28aa870eabe4 req-590a6ba4-0e0a-43bc-b8dd-b87e47cc4d14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0da3e1d4-06bf-46de-86eb-68d5f43ba5c5", "name": "network-vif-plugged", "status": "completed", "tag": "984dabc2-cade-4581-ad2d-f7a02987fca5"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:37.008749 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:51:37.008749 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:51:37.018593 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-d54f89fa-14c0-412a-a8de-28aa870eabe4 req-590a6ba4-0e0a-43bc-b8dd-b87e47cc4d14 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:37.020060 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-d54f89fa-14c0-412a-a8de-28aa870eabe4 req-590a6ba4-0e0a-43bc-b8dd-b87e47cc4d14 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:37.037045 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-d54f89fa-14c0-412a-a8de-28aa870eabe4 req-590a6ba4-0e0a-43bc-b8dd-b87e47cc4d14 service nova] Creating event network-vif-plugged:984dabc2-cade-4581-ad2d-f7a02987fca5 for instance 0da3e1d4-06bf-46de-86eb-68d5f43ba5c5 on hv-cinder-78447 Dec 16 15:51:37.043693 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-d54f89fa-14c0-412a-a8de-28aa870eabe4 req-590a6ba4-0e0a-43bc-b8dd-b87e47cc4d14 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039709 Dec 16 15:51:37.045004 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 263/478] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:51:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:51:37.053136 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-5a1086cc-ad2c-48ec-ba57-9ddfa7313088 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:37.053876 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-5a1086cc-ad2c-48ec-ba57-9ddfa7313088 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 0da3e1d4-06bf-46de-86eb-68d5f43ba5c5] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:37.059920 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5a1086cc-ad2c-48ec-ba57-9ddfa7313088 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:37.060361 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5a1086cc-ad2c-48ec-ba57-9ddfa7313088 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:37.061143 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5a1086cc-ad2c-48ec-ba57-9ddfa7313088 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:37.061606 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5a1086cc-ad2c-48ec-ba57-9ddfa7313088 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:37.172690 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-83d6aad1-0927-4d29-b335-ce3094ce20ec tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:37.182434 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-83d6aad1-0927-4d29-b335-ce3094ce20ec tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c" status: 200 len: 1513 microversion: 2.1 time: 0.264992 Dec 16 15:51:37.182434 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 216/479] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:36 2021] GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c => generated 1513 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:37.287272 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-5a1086cc-ad2c-48ec-ba57-9ddfa7313088 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724c34ba12d8461fa8093c2f617f2755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7aae25eb2ad4219aff78b5f9150925f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:37.294778 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-5a1086cc-ad2c-48ec-ba57-9ddfa7313088 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "GET /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5" status: 200 len: 1313 microversion: 2.1 time: 0.245775 Dec 16 15:51:37.295709 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 264/480] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:37 2021] GET /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:37.934344 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-fbd7c9a2-b2ef-498d-8a80-f789188140d4 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:37.935942 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-fbd7c9a2-b2ef-498d-8a80-f789188140d4 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:37.943752 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-fbd7c9a2-b2ef-498d-8a80-f789188140d4 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:37.944530 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-fbd7c9a2-b2ef-498d-8a80-f789188140d4 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:37.945737 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-fbd7c9a2-b2ef-498d-8a80-f789188140d4 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:37.946323 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-fbd7c9a2-b2ef-498d-8a80-f789188140d4 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:38.019431 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-3c2a5657-df71-4ff2-addf-6839e852ca08 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:38.020107 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-3c2a5657-df71-4ff2-addf-6839e852ca08 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:38.027413 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3c2a5657-df71-4ff2-addf-6839e852ca08 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:38.027870 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3c2a5657-df71-4ff2-addf-6839e852ca08 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:38.028774 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3c2a5657-df71-4ff2-addf-6839e852ca08 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:38.029083 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3c2a5657-df71-4ff2-addf-6839e852ca08 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:38.170088 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-fbd7c9a2-b2ef-498d-8a80-f789188140d4 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:38.204229 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-fbd7c9a2-b2ef-498d-8a80-f789188140d4 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1721 microversion: 2.1 time: 0.276645 Dec 16 15:51:38.214824 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 217/481] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:37 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1721 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:38.226900 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-54a64c98-9dd5-43f1-9c3c-5ab1558a900d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:38.227537 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-54a64c98-9dd5-43f1-9c3c-5ab1558a900d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 07a50ac4-a4f8-411a-9457-cd592eab7e7c] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:38.234782 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-54a64c98-9dd5-43f1-9c3c-5ab1558a900d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:38.235230 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-54a64c98-9dd5-43f1-9c3c-5ab1558a900d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:38.236016 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-54a64c98-9dd5-43f1-9c3c-5ab1558a900d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:38.236447 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-54a64c98-9dd5-43f1-9c3c-5ab1558a900d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:38.297847 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-3c2a5657-df71-4ff2-addf-6839e852ca08 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:38.308922 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-3c2a5657-df71-4ff2-addf-6839e852ca08 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1568 microversion: 2.1 time: 0.293233 Dec 16 15:51:38.309788 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 265/482] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:38 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1568 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:51:38.315570 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-6d889312-c7a8-47e7-ac7a-0f7870f6e9b9 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:38.316402 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-6d889312-c7a8-47e7-ac7a-0f7870f6e9b9 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 0da3e1d4-06bf-46de-86eb-68d5f43ba5c5] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:38.323547 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6d889312-c7a8-47e7-ac7a-0f7870f6e9b9 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:38.324243 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6d889312-c7a8-47e7-ac7a-0f7870f6e9b9 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:38.325210 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6d889312-c7a8-47e7-ac7a-0f7870f6e9b9 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:38.326774 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6d889312-c7a8-47e7-ac7a-0f7870f6e9b9 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:38.448401 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-54a64c98-9dd5-43f1-9c3c-5ab1558a900d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:38.457852 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-54a64c98-9dd5-43f1-9c3c-5ab1558a900d tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c" status: 200 len: 1513 microversion: 2.1 time: 0.247109 Dec 16 15:51:38.458450 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 218/483] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:38 2021] GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c => generated 1513 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:38.500918 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-6d889312-c7a8-47e7-ac7a-0f7870f6e9b9 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724c34ba12d8461fa8093c2f617f2755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7aae25eb2ad4219aff78b5f9150925f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:38.509285 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-6d889312-c7a8-47e7-ac7a-0f7870f6e9b9 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "GET /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5" status: 200 len: 1313 microversion: 2.1 time: 0.198310 Dec 16 15:51:38.509930 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 266/484] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:38 2021] GET /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:39.222868 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-6d3703c4-216f-4917-a74c-fe692c5104c6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:39.223866 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-6d3703c4-216f-4917-a74c-fe692c5104c6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:39.242274 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6d3703c4-216f-4917-a74c-fe692c5104c6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:39.242927 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6d3703c4-216f-4917-a74c-fe692c5104c6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:39.243794 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6d3703c4-216f-4917-a74c-fe692c5104c6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:39.244235 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6d3703c4-216f-4917-a74c-fe692c5104c6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:39.288903 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-c64bceda-7fd5-42bd-8835-294fddb5914b req-a44eb717-72da-484e-8cbe-9c4b9e80abc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07a50ac4-a4f8-411a-9457-cd592eab7e7c", "name": "network-vif-deleted", "tag": "0711d501-f11e-421f-aa27-451f8a86c7e6"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:39.291699 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:51:39.291699 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:51:39.304133 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-c64bceda-7fd5-42bd-8835-294fddb5914b req-a44eb717-72da-484e-8cbe-9c4b9e80abc6 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:39.307625 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-c64bceda-7fd5-42bd-8835-294fddb5914b req-a44eb717-72da-484e-8cbe-9c4b9e80abc6 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:39.342874 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-c64bceda-7fd5-42bd-8835-294fddb5914b req-a44eb717-72da-484e-8cbe-9c4b9e80abc6 service nova] Creating event network-vif-deleted:0711d501-f11e-421f-aa27-451f8a86c7e6 for instance 07a50ac4-a4f8-411a-9457-cd592eab7e7c on hv-cinder-78447 Dec 16 15:51:39.348134 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-c64bceda-7fd5-42bd-8835-294fddb5914b req-a44eb717-72da-484e-8cbe-9c4b9e80abc6 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063838 Dec 16 15:51:39.350362 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 267/485] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:51:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:51:39.356232 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-61f72fe7-4da1-4bbc-86ac-bfb78dac773e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:39.357104 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-61f72fe7-4da1-4bbc-86ac-bfb78dac773e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:39.365434 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-61f72fe7-4da1-4bbc-86ac-bfb78dac773e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:39.366197 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-61f72fe7-4da1-4bbc-86ac-bfb78dac773e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:39.367226 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-61f72fe7-4da1-4bbc-86ac-bfb78dac773e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:39.367860 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-61f72fe7-4da1-4bbc-86ac-bfb78dac773e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:39.500691 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-6d3703c4-216f-4917-a74c-fe692c5104c6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:39.511010 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-6d3703c4-216f-4917-a74c-fe692c5104c6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1721 microversion: 2.1 time: 0.291316 Dec 16 15:51:39.512207 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 219/486] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:39 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1721 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:51:39.519165 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-2b5a3581-2b60-44d1-97f0-3420e176e37b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:39.521355 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-2b5a3581-2b60-44d1-97f0-3420e176e37b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 07a50ac4-a4f8-411a-9457-cd592eab7e7c] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:39.530855 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2b5a3581-2b60-44d1-97f0-3420e176e37b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:39.531296 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2b5a3581-2b60-44d1-97f0-3420e176e37b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:39.532220 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2b5a3581-2b60-44d1-97f0-3420e176e37b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:39.532758 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2b5a3581-2b60-44d1-97f0-3420e176e37b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:39.547191 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-61f72fe7-4da1-4bbc-86ac-bfb78dac773e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:39.555769 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-61f72fe7-4da1-4bbc-86ac-bfb78dac773e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1548 microversion: 2.1 time: 0.204006 Dec 16 15:51:39.556353 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 268/487] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:39 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1548 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:39.564405 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2b5a3581-2b60-44d1-97f0-3420e176e37b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:39.564828 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2b5a3581-2b60-44d1-97f0-3420e176e37b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:39.565264 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.objects.instance [None req-2b5a3581-2b60-44d1-97f0-3420e176e37b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lazy-loading 'fault' on Instance uuid 07a50ac4-a4f8-411a-9457-cd592eab7e7c {{(pid=122398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:51:39.571289 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-46a4a56e-0c6d-435b-86c9-df0f3d31e32d tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:39.571896 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-46a4a56e-0c6d-435b-86c9-df0f3d31e32d tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 0da3e1d4-06bf-46de-86eb-68d5f43ba5c5] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:39.577492 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-46a4a56e-0c6d-435b-86c9-df0f3d31e32d tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:39.577947 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-46a4a56e-0c6d-435b-86c9-df0f3d31e32d tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:39.578714 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-46a4a56e-0c6d-435b-86c9-df0f3d31e32d tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:39.579148 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-46a4a56e-0c6d-435b-86c9-df0f3d31e32d tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:39.608029 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-2b5a3581-2b60-44d1-97f0-3420e176e37b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:39.616452 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-2b5a3581-2b60-44d1-97f0-3420e176e37b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c" status: 200 len: 1307 microversion: 2.1 time: 0.102110 Dec 16 15:51:39.617019 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 220/488] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:39 2021] GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c => generated 1307 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:39.621599 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-acfd7944-06a2-4a41-92ea-6cf874cb61c0 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:39.622334 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-acfd7944-06a2-4a41-92ea-6cf874cb61c0 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:39.628807 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-acfd7944-06a2-4a41-92ea-6cf874cb61c0 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:39.629235 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-acfd7944-06a2-4a41-92ea-6cf874cb61c0 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:39.630049 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-acfd7944-06a2-4a41-92ea-6cf874cb61c0 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:39.630471 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-acfd7944-06a2-4a41-92ea-6cf874cb61c0 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:39.713044 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.wsgi [None req-acfd7944-06a2-4a41-92ea-6cf874cb61c0 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] HTTP exception thrown: Cannot 'detach_volume' instance 05750574-60a7-44f6-8fd6-d2fd52b57e91 while it is in vm_state rescued Dec 16 15:51:39.713899 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-acfd7944-06a2-4a41-92ea-6cf874cb61c0 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Returning 409 to user: Cannot 'detach_volume' instance 05750574-60a7-44f6-8fd6-d2fd52b57e91 while it is in vm_state rescued {{(pid=122398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:51:39.715010 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-acfd7944-06a2-4a41-92ea-6cf874cb61c0 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "DELETE /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91/os-volume_attachments/7a0e5f9f-fb4f-4d55-a7fd-ec07d618446a" status: 409 len: 152 microversion: 2.1 time: 0.097036 Dec 16 15:51:39.715815 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 221/489] 10.222.0.31 () {58 vars in 1415 bytes} [Thu Dec 16 15:51:39 2021] DELETE /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91/os-volume_attachments/7a0e5f9f-fb4f-4d55-a7fd-ec07d618446a => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 16 15:51:39.723543 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-46a4a56e-0c6d-435b-86c9-df0f3d31e32d tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724c34ba12d8461fa8093c2f617f2755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7aae25eb2ad4219aff78b5f9150925f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:39.725740 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-54afa04c-f980-4f25-8990-d27157f714bf tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:39.726548 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-54afa04c-f980-4f25-8990-d27157f714bf tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:39.732742 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-54afa04c-f980-4f25-8990-d27157f714bf tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:39.733181 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-54afa04c-f980-4f25-8990-d27157f714bf tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:39.734095 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-54afa04c-f980-4f25-8990-d27157f714bf tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:39.734519 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-54afa04c-f980-4f25-8990-d27157f714bf tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:39.734715 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-46a4a56e-0c6d-435b-86c9-df0f3d31e32d tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "GET /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5" status: 200 len: 1498 microversion: 2.1 time: 0.166952 Dec 16 15:51:39.735300 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 269/490] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:39 2021] GET /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5 => generated 1498 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:39.806419 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-54afa04c-f980-4f25-8990-d27157f714bf tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "POST /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91/action" status: 202 len: 0 microversion: 2.1 time: 0.085876 Dec 16 15:51:39.807039 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 222/491] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:51:39 2021] POST /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:51:39.815763 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-127562c2-a082-493d-b851-8061d04c15da tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:39.816464 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-127562c2-a082-493d-b851-8061d04c15da tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:39.822647 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-127562c2-a082-493d-b851-8061d04c15da tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:39.823101 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-127562c2-a082-493d-b851-8061d04c15da tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:39.823888 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-127562c2-a082-493d-b851-8061d04c15da tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:39.824342 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-127562c2-a082-493d-b851-8061d04c15da tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:39.999878 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-127562c2-a082-493d-b851-8061d04c15da tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:40.010729 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-127562c2-a082-493d-b851-8061d04c15da tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1556 microversion: 2.1 time: 0.198621 Dec 16 15:51:40.011716 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 270/492] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:39 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1556 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:40.267229 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-56fb20ed-07cd-4c3c-9644-e5cba4e36023 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:40.268716 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-56fb20ed-07cd-4c3c-9644-e5cba4e36023 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 0da3e1d4-06bf-46de-86eb-68d5f43ba5c5] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:40.276403 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-56fb20ed-07cd-4c3c-9644-e5cba4e36023 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:40.277116 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-56fb20ed-07cd-4c3c-9644-e5cba4e36023 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:40.278302 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-56fb20ed-07cd-4c3c-9644-e5cba4e36023 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:40.278825 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-56fb20ed-07cd-4c3c-9644-e5cba4e36023 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:40.305346 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-56fb20ed-07cd-4c3c-9644-e5cba4e36023 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 0da3e1d4-06bf-46de-86eb-68d5f43ba5c5] Going to try to terminate instance {{(pid=122398) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 15:51:40.401299 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-56fb20ed-07cd-4c3c-9644-e5cba4e36023 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "DELETE /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5" status: 204 len: 0 microversion: 2.1 time: 0.138353 Dec 16 15:51:40.401985 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 223/493] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Dec 16 15:51:40 2021] DELETE /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:51:40.412450 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-da014c07-817f-4f51-ad1b-1a9d1b2b2c31 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:40.413055 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-da014c07-817f-4f51-ad1b-1a9d1b2b2c31 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 0da3e1d4-06bf-46de-86eb-68d5f43ba5c5] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:40.419466 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-da014c07-817f-4f51-ad1b-1a9d1b2b2c31 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:40.419904 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-da014c07-817f-4f51-ad1b-1a9d1b2b2c31 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:40.420684 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-da014c07-817f-4f51-ad1b-1a9d1b2b2c31 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:40.421301 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-da014c07-817f-4f51-ad1b-1a9d1b2b2c31 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:40.529118 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-741012e6-6927-491e-9f43-f7f8204afb61 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:40.530251 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-741012e6-6927-491e-9f43-f7f8204afb61 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:40.536328 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-741012e6-6927-491e-9f43-f7f8204afb61 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:40.536764 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-741012e6-6927-491e-9f43-f7f8204afb61 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:40.537576 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-741012e6-6927-491e-9f43-f7f8204afb61 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:40.538001 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-741012e6-6927-491e-9f43-f7f8204afb61 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:40.573613 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-da014c07-817f-4f51-ad1b-1a9d1b2b2c31 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724c34ba12d8461fa8093c2f617f2755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7aae25eb2ad4219aff78b5f9150925f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:40.586421 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-da014c07-817f-4f51-ad1b-1a9d1b2b2c31 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "GET /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5" status: 200 len: 1504 microversion: 2.1 time: 0.178707 Dec 16 15:51:40.587307 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 271/494] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:40 2021] GET /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5 => generated 1504 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:40.635483 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ed58deb5-f623-4a3a-bcc9-cfe3fb88e1ba tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:40.635483 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-ed58deb5-f623-4a3a-bcc9-cfe3fb88e1ba tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 07a50ac4-a4f8-411a-9457-cd592eab7e7c] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:40.640365 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ed58deb5-f623-4a3a-bcc9-cfe3fb88e1ba tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:40.640893 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ed58deb5-f623-4a3a-bcc9-cfe3fb88e1ba tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:40.641892 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ed58deb5-f623-4a3a-bcc9-cfe3fb88e1ba tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:40.642532 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ed58deb5-f623-4a3a-bcc9-cfe3fb88e1ba tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:40.660120 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.wsgi [None req-ed58deb5-f623-4a3a-bcc9-cfe3fb88e1ba tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] HTTP exception thrown: Instance 07a50ac4-a4f8-411a-9457-cd592eab7e7c could not be found. Dec 16 15:51:40.662230 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ed58deb5-f623-4a3a-bcc9-cfe3fb88e1ba tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Returning 404 to user: Instance 07a50ac4-a4f8-411a-9457-cd592eab7e7c could not be found. {{(pid=122399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:51:40.663146 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-ed58deb5-f623-4a3a-bcc9-cfe3fb88e1ba tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c" status: 404 len: 111 microversion: 2.1 time: 0.034048 Dec 16 15:51:40.663980 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 272/495] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:40 2021] GET /compute/v2.1/servers/07a50ac4-a4f8-411a-9457-cd592eab7e7c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 16 15:51:40.691978 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-741012e6-6927-491e-9f43-f7f8204afb61 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:40.700048 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-741012e6-6927-491e-9f43-f7f8204afb61 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1721 microversion: 2.1 time: 0.175383 Dec 16 15:51:40.700652 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 224/496] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:40 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:51:41.029216 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-35db2500-ef00-4b8e-823e-8f8a1aec12dd tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:41.029841 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-35db2500-ef00-4b8e-823e-8f8a1aec12dd tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:41.035799 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-35db2500-ef00-4b8e-823e-8f8a1aec12dd tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:41.036240 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-35db2500-ef00-4b8e-823e-8f8a1aec12dd tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:41.037017 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-35db2500-ef00-4b8e-823e-8f8a1aec12dd tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:41.037479 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-35db2500-ef00-4b8e-823e-8f8a1aec12dd tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:41.179471 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-35db2500-ef00-4b8e-823e-8f8a1aec12dd tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:41.189624 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-35db2500-ef00-4b8e-823e-8f8a1aec12dd tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1556 microversion: 2.1 time: 0.164239 Dec 16 15:51:41.203748 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 273/497] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:41 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:41.604059 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-3c81ab4f-0ed0-452a-bdfc-bcaeb1327aae tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:41.605558 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-3c81ab4f-0ed0-452a-bdfc-bcaeb1327aae tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 0da3e1d4-06bf-46de-86eb-68d5f43ba5c5] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:41.611865 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3c81ab4f-0ed0-452a-bdfc-bcaeb1327aae tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:41.612533 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3c81ab4f-0ed0-452a-bdfc-bcaeb1327aae tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:41.613320 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3c81ab4f-0ed0-452a-bdfc-bcaeb1327aae tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:41.613817 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3c81ab4f-0ed0-452a-bdfc-bcaeb1327aae tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:41.717648 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-f318ca4e-749a-4e7d-89f0-ba0480d40bb3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:41.721754 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-f318ca4e-749a-4e7d-89f0-ba0480d40bb3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:41.743492 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f318ca4e-749a-4e7d-89f0-ba0480d40bb3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:41.743992 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f318ca4e-749a-4e7d-89f0-ba0480d40bb3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:41.746090 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f318ca4e-749a-4e7d-89f0-ba0480d40bb3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:41.746696 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f318ca4e-749a-4e7d-89f0-ba0480d40bb3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:42.052222 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-3c81ab4f-0ed0-452a-bdfc-bcaeb1327aae tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724c34ba12d8461fa8093c2f617f2755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7aae25eb2ad4219aff78b5f9150925f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:42.060593 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-3c81ab4f-0ed0-452a-bdfc-bcaeb1327aae tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "GET /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5" status: 200 len: 1504 microversion: 2.1 time: 0.460818 Dec 16 15:51:42.061579 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 225/498] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:41 2021] GET /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5 => generated 1504 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:42.068239 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-a986c32d-1f59-4872-9bf1-725b9bd99c94 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:42.069172 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-a986c32d-1f59-4872-9bf1-725b9bd99c94 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:42.077778 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a986c32d-1f59-4872-9bf1-725b9bd99c94 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:42.078325 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a986c32d-1f59-4872-9bf1-725b9bd99c94 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:42.079289 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a986c32d-1f59-4872-9bf1-725b9bd99c94 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:42.079815 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a986c32d-1f59-4872-9bf1-725b9bd99c94 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:42.108694 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-a986c32d-1f59-4872-9bf1-725b9bd99c94 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Going to try to terminate instance {{(pid=122398) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 15:51:42.134185 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-f318ca4e-749a-4e7d-89f0-ba0480d40bb3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:42.142218 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-f318ca4e-749a-4e7d-89f0-ba0480d40bb3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1721 microversion: 2.1 time: 0.428724 Dec 16 15:51:42.142983 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 274/499] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:41 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1721 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:42.211060 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-25ea7b81-c82a-49fb-9cba-f46196cb4487 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:42.211674 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-25ea7b81-c82a-49fb-9cba-f46196cb4487 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:42.219004 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-25ea7b81-c82a-49fb-9cba-f46196cb4487 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:42.219608 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-25ea7b81-c82a-49fb-9cba-f46196cb4487 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:42.220573 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-25ea7b81-c82a-49fb-9cba-f46196cb4487 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:42.221070 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-25ea7b81-c82a-49fb-9cba-f46196cb4487 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:42.234597 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-a986c32d-1f59-4872-9bf1-725b9bd99c94 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "DELETE /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc" status: 204 len: 0 microversion: 2.1 time: 0.170115 Dec 16 15:51:42.237159 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 226/500] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Dec 16 15:51:42 2021] DELETE /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:51:42.253980 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-6d0f5016-cef2-4224-8e2b-757fbe10354b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:42.255102 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-6d0f5016-cef2-4224-8e2b-757fbe10354b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:42.261782 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6d0f5016-cef2-4224-8e2b-757fbe10354b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:42.262230 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6d0f5016-cef2-4224-8e2b-757fbe10354b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:42.263083 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6d0f5016-cef2-4224-8e2b-757fbe10354b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:42.263470 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6d0f5016-cef2-4224-8e2b-757fbe10354b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:42.512279 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-6d0f5016-cef2-4224-8e2b-757fbe10354b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:42.519840 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-6d0f5016-cef2-4224-8e2b-757fbe10354b tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc" status: 200 len: 1514 microversion: 2.1 time: 0.278557 Dec 16 15:51:42.520445 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 227/501] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:42 2021] GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc => generated 1514 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:51:42.538708 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-25ea7b81-c82a-49fb-9cba-f46196cb4487 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:42.553332 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-25ea7b81-c82a-49fb-9cba-f46196cb4487 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1556 microversion: 2.1 time: 0.341344 Dec 16 15:51:42.554385 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 275/502] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:42 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1556 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:51:42.814452 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-d75e1d1d-0cf0-4175-984f-c8ae3164c083 req-71f662a5-0c7e-4f9d-a6b2-544df2379a2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0da3e1d4-06bf-46de-86eb-68d5f43ba5c5", "name": "network-vif-deleted", "tag": "984dabc2-cade-4581-ad2d-f7a02987fca5"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:42.817240 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:51:42.817240 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:51:42.828060 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-d75e1d1d-0cf0-4175-984f-c8ae3164c083 req-71f662a5-0c7e-4f9d-a6b2-544df2379a2d service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:42.828490 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-d75e1d1d-0cf0-4175-984f-c8ae3164c083 req-71f662a5-0c7e-4f9d-a6b2-544df2379a2d service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:42.840790 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-d75e1d1d-0cf0-4175-984f-c8ae3164c083 req-71f662a5-0c7e-4f9d-a6b2-544df2379a2d service nova] Creating event network-vif-deleted:984dabc2-cade-4581-ad2d-f7a02987fca5 for instance 0da3e1d4-06bf-46de-86eb-68d5f43ba5c5 on hv-cinder-78447 Dec 16 15:51:42.845825 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-d75e1d1d-0cf0-4175-984f-c8ae3164c083 req-71f662a5-0c7e-4f9d-a6b2-544df2379a2d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036490 Dec 16 15:51:42.849782 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 228/503] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:51:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:51:43.077078 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-21c46b3a-d6b6-432c-aed8-9cb402d02975 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:43.077711 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-21c46b3a-d6b6-432c-aed8-9cb402d02975 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 0da3e1d4-06bf-46de-86eb-68d5f43ba5c5] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:43.084080 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-21c46b3a-d6b6-432c-aed8-9cb402d02975 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:43.084519 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-21c46b3a-d6b6-432c-aed8-9cb402d02975 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:43.085296 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-21c46b3a-d6b6-432c-aed8-9cb402d02975 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:43.085754 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-21c46b3a-d6b6-432c-aed8-9cb402d02975 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:43.115695 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-21c46b3a-d6b6-432c-aed8-9cb402d02975 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:43.116131 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-21c46b3a-d6b6-432c-aed8-9cb402d02975 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:43.116568 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.objects.instance [None req-21c46b3a-d6b6-432c-aed8-9cb402d02975 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lazy-loading 'fault' on Instance uuid 0da3e1d4-06bf-46de-86eb-68d5f43ba5c5 {{(pid=122399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:51:43.157425 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-21c46b3a-d6b6-432c-aed8-9cb402d02975 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724c34ba12d8461fa8093c2f617f2755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7aae25eb2ad4219aff78b5f9150925f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:43.161200 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-12ea2e43-1076-43ae-8824-508e07efc2b6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:43.161931 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-12ea2e43-1076-43ae-8824-508e07efc2b6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:43.166166 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-21c46b3a-d6b6-432c-aed8-9cb402d02975 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "GET /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5" status: 200 len: 1303 microversion: 2.1 time: 0.092770 Dec 16 15:51:43.166752 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 276/504] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:43 2021] GET /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5 => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:43.168699 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-12ea2e43-1076-43ae-8824-508e07efc2b6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:43.169173 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-12ea2e43-1076-43ae-8824-508e07efc2b6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:43.169993 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-12ea2e43-1076-43ae-8824-508e07efc2b6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:43.170455 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-12ea2e43-1076-43ae-8824-508e07efc2b6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:43.319931 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-12ea2e43-1076-43ae-8824-508e07efc2b6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:43.328303 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-12ea2e43-1076-43ae-8824-508e07efc2b6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1721 microversion: 2.1 time: 0.171922 Dec 16 15:51:43.328845 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 229/505] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:43 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:43.538749 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-f80538a3-3466-49c6-b495-13e64b59c43f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:43.539627 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-f80538a3-3466-49c6-b495-13e64b59c43f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:43.548845 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f80538a3-3466-49c6-b495-13e64b59c43f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:43.549785 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f80538a3-3466-49c6-b495-13e64b59c43f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:43.550107 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f80538a3-3466-49c6-b495-13e64b59c43f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:43.550691 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f80538a3-3466-49c6-b495-13e64b59c43f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:43.570911 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-6251bb04-9ccc-4e2b-a9a8-9f2cffb241b8 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:43.571537 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-6251bb04-9ccc-4e2b-a9a8-9f2cffb241b8 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:43.578795 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6251bb04-9ccc-4e2b-a9a8-9f2cffb241b8 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:43.579616 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6251bb04-9ccc-4e2b-a9a8-9f2cffb241b8 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:43.581052 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6251bb04-9ccc-4e2b-a9a8-9f2cffb241b8 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:43.582119 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6251bb04-9ccc-4e2b-a9a8-9f2cffb241b8 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:43.756588 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-f80538a3-3466-49c6-b495-13e64b59c43f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:43.762093 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-6251bb04-9ccc-4e2b-a9a8-9f2cffb241b8 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:43.764759 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-f80538a3-3466-49c6-b495-13e64b59c43f tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc" status: 200 len: 1514 microversion: 2.1 time: 0.231779 Dec 16 15:51:43.765633 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 277/506] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:43 2021] GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:43.776254 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-6251bb04-9ccc-4e2b-a9a8-9f2cffb241b8 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1562 microversion: 2.1 time: 0.209072 Dec 16 15:51:43.776822 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 230/507] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:43 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1562 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:43.840883 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-b20a633e-9dc5-4bc9-8a9c-a7b91c7b767a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:43.841378 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-b20a633e-9dc5-4bc9-8a9c-a7b91c7b767a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:43.847750 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b20a633e-9dc5-4bc9-8a9c-a7b91c7b767a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:43.848245 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b20a633e-9dc5-4bc9-8a9c-a7b91c7b767a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:43.849028 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b20a633e-9dc5-4bc9-8a9c-a7b91c7b767a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:43.849837 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b20a633e-9dc5-4bc9-8a9c-a7b91c7b767a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:43.970104 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.objects.instance [None req-b20a633e-9dc5-4bc9-8a9c-a7b91c7b767a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lazy-loading 'services' on Instance uuid 05750574-60a7-44f6-8fd6-d2fd52b57e91 {{(pid=122399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:51:44.090092 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-b20a633e-9dc5-4bc9-8a9c-a7b91c7b767a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "DELETE /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91/os-volume_attachments/7a0e5f9f-fb4f-4d55-a7fd-ec07d618446a" status: 202 len: 0 microversion: 2.1 time: 0.252794 Dec 16 15:51:44.091144 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 278/508] 10.222.0.31 () {58 vars in 1415 bytes} [Thu Dec 16 15:51:43 2021] DELETE /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91/os-volume_attachments/7a0e5f9f-fb4f-4d55-a7fd-ec07d618446a => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:51:44.099129 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-55268090-c7d7-446b-9d50-cb05cf2631fb tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:44.100431 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-55268090-c7d7-446b-9d50-cb05cf2631fb tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:44.107128 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-55268090-c7d7-446b-9d50-cb05cf2631fb tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:44.107939 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-55268090-c7d7-446b-9d50-cb05cf2631fb tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:44.108899 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-55268090-c7d7-446b-9d50-cb05cf2631fb tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:44.109537 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-55268090-c7d7-446b-9d50-cb05cf2631fb tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:44.152887 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-55268090-c7d7-446b-9d50-cb05cf2631fb tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057635 Dec 16 15:51:44.154129 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 231/509] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Dec 16 15:51:44 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:51:44.183921 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-5366e070-73f9-435c-b7b6-a3f8957f9aff tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:44.184974 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-5366e070-73f9-435c-b7b6-a3f8957f9aff tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 0da3e1d4-06bf-46de-86eb-68d5f43ba5c5] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:44.192012 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5366e070-73f9-435c-b7b6-a3f8957f9aff tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:44.192498 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5366e070-73f9-435c-b7b6-a3f8957f9aff tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:44.193799 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5366e070-73f9-435c-b7b6-a3f8957f9aff tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:44.194358 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5366e070-73f9-435c-b7b6-a3f8957f9aff tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:44.212351 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.wsgi [None req-5366e070-73f9-435c-b7b6-a3f8957f9aff tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] HTTP exception thrown: Instance 0da3e1d4-06bf-46de-86eb-68d5f43ba5c5 could not be found. Dec 16 15:51:44.212351 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-5366e070-73f9-435c-b7b6-a3f8957f9aff tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Returning 404 to user: Instance 0da3e1d4-06bf-46de-86eb-68d5f43ba5c5 could not be found. {{(pid=122399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:51:44.213446 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-5366e070-73f9-435c-b7b6-a3f8957f9aff tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "GET /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5" status: 404 len: 111 microversion: 2.1 time: 0.033994 Dec 16 15:51:44.214024 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 279/510] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:44 2021] GET /compute/v2.1/servers/0da3e1d4-06bf-46de-86eb-68d5f43ba5c5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 16 15:51:44.314608 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-a656d24f-5ac2-44c3-9c0f-1306803f32ba tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2038341008", "imageRef": "2a1434ad-0c2c-4725-baad-a605624baf01", "flavorRef": "452", "networks": [{"uuid": "eff1aea5-661c-4e32-824f-eec13ded2085"}]}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:44.345440 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-74c7843c-b8ee-44fe-b16f-ac11129181fa tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:44.346376 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-74c7843c-b8ee-44fe-b16f-ac11129181fa tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:44.353203 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-74c7843c-b8ee-44fe-b16f-ac11129181fa tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:44.353692 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-74c7843c-b8ee-44fe-b16f-ac11129181fa tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:44.354478 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-74c7843c-b8ee-44fe-b16f-ac11129181fa tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:44.355081 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-74c7843c-b8ee-44fe-b16f-ac11129181fa tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:44.367964 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.network.neutron [None req-a656d24f-5ac2-44c3-9c0f-1306803f32ba tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] validate_networks() for [('eff1aea5-661c-4e32-824f-eec13ded2085', None, None, None, None, None)] {{(pid=122398) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 15:51:44.606257 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-74c7843c-b8ee-44fe-b16f-ac11129181fa tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:44.623784 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-74c7843c-b8ee-44fe-b16f-ac11129181fa tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1721 microversion: 2.1 time: 0.278422 Dec 16 15:51:44.624765 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 280/511] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:44 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1721 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:44.781912 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-36761a7c-1d8b-47b1-b518-b8e2474f25f9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:44.782558 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-36761a7c-1d8b-47b1-b518-b8e2474f25f9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:44.788958 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-36761a7c-1d8b-47b1-b518-b8e2474f25f9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:44.789442 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-36761a7c-1d8b-47b1-b518-b8e2474f25f9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:44.790245 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-36761a7c-1d8b-47b1-b518-b8e2474f25f9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:44.790684 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-36761a7c-1d8b-47b1-b518-b8e2474f25f9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:44.824157 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-a656d24f-5ac2-44c3-9c0f-1306803f32ba tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Flavor limits 0:0:0 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 15:51:44.824687 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-a656d24f-5ac2-44c3-9c0f-1306803f32ba tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Image limits 0:0:0 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 15:51:44.825257 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-36761a7c-1d8b-47b1-b518-b8e2474f25f9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:44.825810 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-36761a7c-1d8b-47b1-b518-b8e2474f25f9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:44.825978 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-a656d24f-5ac2-44c3-9c0f-1306803f32ba tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Flavor pref 0:0:0 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 15:51:44.826413 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-a656d24f-5ac2-44c3-9c0f-1306803f32ba tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Image pref 0:0:0 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 15:51:44.826535 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.objects.instance [None req-36761a7c-1d8b-47b1-b518-b8e2474f25f9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lazy-loading 'fault' on Instance uuid 833cc951-4fe1-4d89-884f-6c98308de4bc {{(pid=122399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:51:44.827052 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-a656d24f-5ac2-44c3-9c0f-1306803f32ba tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 15:51:44.837497 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a656d24f-5ac2-44c3-9c0f-1306803f32ba tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:44.838231 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a656d24f-5ac2-44c3-9c0f-1306803f32ba tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:44.839092 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a656d24f-5ac2-44c3-9c0f-1306803f32ba tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:44.839637 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a656d24f-5ac2-44c3-9c0f-1306803f32ba tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:44.858567 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.quota [None req-a656d24f-5ac2-44c3-9c0f-1306803f32ba tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Getting quotas for project a7aae25eb2ad4219aff78b5f9150925f. Resources: {'instances', 'ram', 'cores'} {{(pid=122398) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:51:44.863663 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.quota [None req-a656d24f-5ac2-44c3-9c0f-1306803f32ba tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Getting quotas for user 724c34ba12d8461fa8093c2f617f2755 and project a7aae25eb2ad4219aff78b5f9150925f. Resources: {'instances', 'ram', 'cores'} {{(pid=122398) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:51:44.875680 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-a656d24f-5ac2-44c3-9c0f-1306803f32ba tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Going to run 1 instances... {{(pid=122398) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 15:51:44.878023 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-a656d24f-5ac2-44c3-9c0f-1306803f32ba tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 5ff7d8ab-5af0-4a1f-a362-c6d43d7492be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a1434ad-0c2c-4725-baad-a605624baf01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122398) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 15:51:44.879324 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-36761a7c-1d8b-47b1-b518-b8e2474f25f9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b1c255006524ad9b700c0711ecbd569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bf2643f52c4cc5aa01ae68ef13e12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:44.887171 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-36761a7c-1d8b-47b1-b518-b8e2474f25f9 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc" status: 200 len: 1308 microversion: 2.1 time: 0.108841 Dec 16 15:51:44.887952 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 281/512] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:44 2021] GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc => generated 1308 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:44.893732 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-098c5180-4bec-4935-b3b2-f1591b572ff2 req-70e6a75a-57da-4a28-bd8f-5d1e76d180f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "833cc951-4fe1-4d89-884f-6c98308de4bc", "name": "network-vif-deleted", "tag": "83410d19-2bd0-4afe-845a-c137ecec96ca"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:44.895810 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:51:44.895810 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:51:44.904223 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-098c5180-4bec-4935-b3b2-f1591b572ff2 req-70e6a75a-57da-4a28-bd8f-5d1e76d180f2 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:44.904666 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-098c5180-4bec-4935-b3b2-f1591b572ff2 req-70e6a75a-57da-4a28-bd8f-5d1e76d180f2 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:44.919520 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-098c5180-4bec-4935-b3b2-f1591b572ff2 req-70e6a75a-57da-4a28-bd8f-5d1e76d180f2 service nova] Creating event network-vif-deleted:83410d19-2bd0-4afe-845a-c137ecec96ca for instance 833cc951-4fe1-4d89-884f-6c98308de4bc on hv-cinder-78447 Dec 16 15:51:44.925318 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-098c5180-4bec-4935-b3b2-f1591b572ff2 req-70e6a75a-57da-4a28-bd8f-5d1e76d180f2 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035738 Dec 16 15:51:44.927156 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 282/513] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:51:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:51:44.931527 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-a656d24f-5ac2-44c3-9c0f-1306803f32ba tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620591 Dec 16 15:51:44.932258 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 232/514] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Dec 16 15:51:44 2021] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 15:51:44.942591 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-b6f6e388-a954-4053-b286-e211e92b19b4 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:44.943502 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-b6f6e388-a954-4053-b286-e211e92b19b4 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 5ff7d8ab-5af0-4a1f-a362-c6d43d7492be] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:45.010093 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-b6f6e388-a954-4053-b286-e211e92b19b4 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724c34ba12d8461fa8093c2f617f2755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7aae25eb2ad4219aff78b5f9150925f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:45.016597 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-b6f6e388-a954-4053-b286-e211e92b19b4 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "GET /compute/v2.1/servers/5ff7d8ab-5af0-4a1f-a362-c6d43d7492be" status: 200 len: 1214 microversion: 2.1 time: 0.077963 Dec 16 15:51:45.017166 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 283/515] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:44 2021] GET /compute/v2.1/servers/5ff7d8ab-5af0-4a1f-a362-c6d43d7492be => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:51:45.165810 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-e3edcad0-1644-4e39-9001-e9067f7cb95d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:45.167794 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-e3edcad0-1644-4e39-9001-e9067f7cb95d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:45.175567 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e3edcad0-1644-4e39-9001-e9067f7cb95d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:45.176221 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e3edcad0-1644-4e39-9001-e9067f7cb95d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:45.177061 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e3edcad0-1644-4e39-9001-e9067f7cb95d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:45.177697 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e3edcad0-1644-4e39-9001-e9067f7cb95d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:45.212163 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-e3edcad0-1644-4e39-9001-e9067f7cb95d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050777 Dec 16 15:51:45.212763 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 233/516] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Dec 16 15:51:45 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:51:45.642102 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-90501ca2-1e63-4742-ae93-538fe3aeebed tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:45.642862 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-90501ca2-1e63-4742-ae93-538fe3aeebed tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:45.649567 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-90501ca2-1e63-4742-ae93-538fe3aeebed tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:45.650022 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-90501ca2-1e63-4742-ae93-538fe3aeebed tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:45.650807 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-90501ca2-1e63-4742-ae93-538fe3aeebed tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:45.651239 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-90501ca2-1e63-4742-ae93-538fe3aeebed tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:45.801602 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-90501ca2-1e63-4742-ae93-538fe3aeebed tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:45.810288 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-90501ca2-1e63-4742-ae93-538fe3aeebed tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1721 microversion: 2.1 time: 0.171975 Dec 16 15:51:45.810862 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 284/517] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:45 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:45.909695 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-f801eefa-a073-4d67-ae1c-a676d8d6ed93 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:45.910604 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-f801eefa-a073-4d67-ae1c-a676d8d6ed93 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] [instance: 833cc951-4fe1-4d89-884f-6c98308de4bc] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:45.917288 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f801eefa-a073-4d67-ae1c-a676d8d6ed93 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:45.917767 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f801eefa-a073-4d67-ae1c-a676d8d6ed93 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:45.918565 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f801eefa-a073-4d67-ae1c-a676d8d6ed93 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:45.918988 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f801eefa-a073-4d67-ae1c-a676d8d6ed93 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:45.932338 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.wsgi [None req-f801eefa-a073-4d67-ae1c-a676d8d6ed93 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] HTTP exception thrown: Instance 833cc951-4fe1-4d89-884f-6c98308de4bc could not be found. Dec 16 15:51:45.932992 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-f801eefa-a073-4d67-ae1c-a676d8d6ed93 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] Returning 404 to user: Instance 833cc951-4fe1-4d89-884f-6c98308de4bc could not be found. {{(pid=122398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:51:45.933880 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-f801eefa-a073-4d67-ae1c-a676d8d6ed93 tempest-AttachVolumeNegativeTest-950246802 tempest-AttachVolumeNegativeTest-950246802-project] 10.222.0.31 "GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc" status: 404 len: 111 microversion: 2.1 time: 0.031383 Dec 16 15:51:45.934408 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 234/518] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:45 2021] GET /compute/v2.1/servers/833cc951-4fe1-4d89-884f-6c98308de4bc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:51:46.035947 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-0bb73a9c-32ee-44fb-bb40-01a9b4e20c59 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:46.036963 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-0bb73a9c-32ee-44fb-bb40-01a9b4e20c59 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 5ff7d8ab-5af0-4a1f-a362-c6d43d7492be] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:46.043195 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0bb73a9c-32ee-44fb-bb40-01a9b4e20c59 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:46.043649 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0bb73a9c-32ee-44fb-bb40-01a9b4e20c59 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:46.044408 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0bb73a9c-32ee-44fb-bb40-01a9b4e20c59 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:46.044833 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0bb73a9c-32ee-44fb-bb40-01a9b4e20c59 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:46.124673 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-0bb73a9c-32ee-44fb-bb40-01a9b4e20c59 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724c34ba12d8461fa8093c2f617f2755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7aae25eb2ad4219aff78b5f9150925f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:46.134467 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-0bb73a9c-32ee-44fb-bb40-01a9b4e20c59 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "GET /compute/v2.1/servers/5ff7d8ab-5af0-4a1f-a362-c6d43d7492be" status: 200 len: 1266 microversion: 2.1 time: 0.102657 Dec 16 15:51:46.135021 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 285/519] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:46 2021] GET /compute/v2.1/servers/5ff7d8ab-5af0-4a1f-a362-c6d43d7492be => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:46.827567 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-3f247bde-cad9-49dd-92ae-99954b3d73cf tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:46.828209 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-3f247bde-cad9-49dd-92ae-99954b3d73cf tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:46.834498 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3f247bde-cad9-49dd-92ae-99954b3d73cf tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:46.834940 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3f247bde-cad9-49dd-92ae-99954b3d73cf tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:46.838309 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3f247bde-cad9-49dd-92ae-99954b3d73cf tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:46.839094 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3f247bde-cad9-49dd-92ae-99954b3d73cf tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:47.014695 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-3f247bde-cad9-49dd-92ae-99954b3d73cf tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:47.023614 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-3f247bde-cad9-49dd-92ae-99954b3d73cf tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1721 microversion: 2.1 time: 0.199984 Dec 16 15:51:47.024196 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 235/520] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:46 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:47.151312 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-a7cf3d79-2362-4c7e-8fd4-70e5b1b78187 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:47.152608 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-a7cf3d79-2362-4c7e-8fd4-70e5b1b78187 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 5ff7d8ab-5af0-4a1f-a362-c6d43d7492be] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:47.160867 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a7cf3d79-2362-4c7e-8fd4-70e5b1b78187 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:47.161617 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a7cf3d79-2362-4c7e-8fd4-70e5b1b78187 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:47.162822 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a7cf3d79-2362-4c7e-8fd4-70e5b1b78187 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:47.163584 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a7cf3d79-2362-4c7e-8fd4-70e5b1b78187 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:47.334469 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-a7cf3d79-2362-4c7e-8fd4-70e5b1b78187 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724c34ba12d8461fa8093c2f617f2755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7aae25eb2ad4219aff78b5f9150925f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:47.342252 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-a7cf3d79-2362-4c7e-8fd4-70e5b1b78187 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "GET /compute/v2.1/servers/5ff7d8ab-5af0-4a1f-a362-c6d43d7492be" status: 200 len: 1314 microversion: 2.1 time: 0.194767 Dec 16 15:51:47.343110 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 286/521] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:47 2021] GET /compute/v2.1/servers/5ff7d8ab-5af0-4a1f-a362-c6d43d7492be => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:47.546714 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-aba7b42f-049b-48ca-a24a-e49287205a3a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:47.547210 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-aba7b42f-049b-48ca-a24a-e49287205a3a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:47.557244 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-aba7b42f-049b-48ca-a24a-e49287205a3a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:47.557735 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-aba7b42f-049b-48ca-a24a-e49287205a3a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:47.558635 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-aba7b42f-049b-48ca-a24a-e49287205a3a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:47.558954 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-aba7b42f-049b-48ca-a24a-e49287205a3a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:47.585699 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-aba7b42f-049b-48ca-a24a-e49287205a3a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Going to try to terminate instance {{(pid=122398) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 15:51:47.682082 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-aba7b42f-049b-48ca-a24a-e49287205a3a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "DELETE /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 204 len: 0 microversion: 2.1 time: 0.138712 Dec 16 15:51:47.682757 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 236/522] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Dec 16 15:51:47 2021] DELETE /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:51:47.696551 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-6c104804-78ad-43ee-9218-0fca575fad9a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:47.697165 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-6c104804-78ad-43ee-9218-0fca575fad9a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:47.703470 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6c104804-78ad-43ee-9218-0fca575fad9a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:47.703916 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6c104804-78ad-43ee-9218-0fca575fad9a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:47.704699 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6c104804-78ad-43ee-9218-0fca575fad9a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:47.705126 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6c104804-78ad-43ee-9218-0fca575fad9a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:47.876965 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-6c104804-78ad-43ee-9218-0fca575fad9a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:47.887163 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-6c104804-78ad-43ee-9218-0fca575fad9a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1507 microversion: 2.1 time: 0.199657 Dec 16 15:51:47.888165 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 287/523] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:47 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1507 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:51:47.951097 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-5b3ef07e-6d07-4c25-a1d4-f73f2f08d719 tempest-VolumesGetTestJSON-47721429 tempest-VolumesGetTestJSON-47721429-project] Action: 'create', calling method: .version_select at 0x7fed5e042820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-528669667", "metadata": {"Type": "work"}}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:48.040334 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-e5368c64-1243-4f7e-8f53-cb2a89605069 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:48.040941 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-e5368c64-1243-4f7e-8f53-cb2a89605069 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:48.048538 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e5368c64-1243-4f7e-8f53-cb2a89605069 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:48.049239 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e5368c64-1243-4f7e-8f53-cb2a89605069 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:48.050039 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e5368c64-1243-4f7e-8f53-cb2a89605069 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:48.050477 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e5368c64-1243-4f7e-8f53-cb2a89605069 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:48.213776 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-e5368c64-1243-4f7e-8f53-cb2a89605069 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:48.223358 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-e5368c64-1243-4f7e-8f53-cb2a89605069 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1721 microversion: 2.1 time: 0.186699 Dec 16 15:51:48.241709 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 288/524] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:48 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1721 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:51:48.246987 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-c5a6a309-c199-40bf-8e5d-e2faddacc52e req-abad65f2-baf0-42cc-961f-9fbbab0099fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ff7d8ab-5af0-4a1f-a362-c6d43d7492be", "tag": "9e7221ff-5d9d-4ed8-8500-cccc65e2b928"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:48.251818 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:51:48.251818 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:51:48.269709 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-c5a6a309-c199-40bf-8e5d-e2faddacc52e req-abad65f2-baf0-42cc-961f-9fbbab0099fe service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:48.270438 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-c5a6a309-c199-40bf-8e5d-e2faddacc52e req-abad65f2-baf0-42cc-961f-9fbbab0099fe service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:48.297200 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-c5a6a309-c199-40bf-8e5d-e2faddacc52e req-abad65f2-baf0-42cc-961f-9fbbab0099fe service nova] Creating event network-changed:9e7221ff-5d9d-4ed8-8500-cccc65e2b928 for instance 5ff7d8ab-5af0-4a1f-a362-c6d43d7492be on hv-cinder-78447 Dec 16 15:51:48.297446 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-5b3ef07e-6d07-4c25-a1d4-f73f2f08d719 tempest-VolumesGetTestJSON-47721429 tempest-VolumesGetTestJSON-47721429-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.540633 Dec 16 15:51:48.298292 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 237/525] 10.222.0.31 () {60 vars in 1155 bytes} [Thu Dec 16 15:51:47 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 543 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 16 15:51:48.305541 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-c5a6a309-c199-40bf-8e5d-e2faddacc52e req-abad65f2-baf0-42cc-961f-9fbbab0099fe service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059597 Dec 16 15:51:48.306801 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 289/526] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:51:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:51:48.310335 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-a8d27efd-4ba0-414a-bacd-ab9310e7bd07 tempest-VolumesGetTestJSON-47721429 tempest-VolumesGetTestJSON-47721429-project] Calling method '.version_select at 0x7fed5e053dc0>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:48.360664 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-43d62077-99a3-41ad-99f8-0b3df31d3123 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:48.361360 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-43d62077-99a3-41ad-99f8-0b3df31d3123 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 5ff7d8ab-5af0-4a1f-a362-c6d43d7492be] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:48.369482 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-43d62077-99a3-41ad-99f8-0b3df31d3123 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:48.369945 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-43d62077-99a3-41ad-99f8-0b3df31d3123 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:48.370732 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-43d62077-99a3-41ad-99f8-0b3df31d3123 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:48.371202 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-43d62077-99a3-41ad-99f8-0b3df31d3123 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:48.380023 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-a8d27efd-4ba0-414a-bacd-ab9310e7bd07 tempest-VolumesGetTestJSON-47721429 tempest-VolumesGetTestJSON-47721429-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/bf8c0e2f-51ff-4483-9757-45212113f857" status: 200 len: 352 microversion: 2.1 time: 0.073384 Dec 16 15:51:48.380147 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 238/527] 10.222.0.31 () {58 vars in 1244 bytes} [Thu Dec 16 15:51:48 2021] GET /compute/v2.1/os-volumes/bf8c0e2f-51ff-4483-9757-45212113f857 => generated 352 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:51:48.516823 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-43d62077-99a3-41ad-99f8-0b3df31d3123 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724c34ba12d8461fa8093c2f617f2755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7aae25eb2ad4219aff78b5f9150925f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:48.524452 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-43d62077-99a3-41ad-99f8-0b3df31d3123 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "GET /compute/v2.1/servers/5ff7d8ab-5af0-4a1f-a362-c6d43d7492be" status: 200 len: 1314 microversion: 2.1 time: 0.167775 Dec 16 15:51:48.525259 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 290/528] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:48 2021] GET /compute/v2.1/servers/5ff7d8ab-5af0-4a1f-a362-c6d43d7492be => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:51:48.904761 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-005d2f88-7cce-43a9-815a-73b4f54f8c9b tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:48.905913 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-005d2f88-7cce-43a9-815a-73b4f54f8c9b tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:48.913834 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-005d2f88-7cce-43a9-815a-73b4f54f8c9b tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:48.914465 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-005d2f88-7cce-43a9-815a-73b4f54f8c9b tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:48.915500 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-005d2f88-7cce-43a9-815a-73b4f54f8c9b tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:48.915933 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-005d2f88-7cce-43a9-815a-73b4f54f8c9b tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:48.932214 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-18f10974-18f7-4f81-a027-340dbd25bf2b tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1860370769", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1132735024", "security_groups": [{"name": "tempest-secgroup-smoke-1062927992"}], "networks": [{"uuid": "9f3bcad2-6582-4016-8d64-28b5be20bd8f"}], "block_device_mapping_v2": [{"uuid": "f4b8cccf-1a1b-4a46-a53d-99871bc79642", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:49.084140 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.network.neutron [None req-18f10974-18f7-4f81-a027-340dbd25bf2b tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] validate_networks() for [('9f3bcad2-6582-4016-8d64-28b5be20bd8f', None, None, None, None, None)] {{(pid=122399) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 15:51:49.092477 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-005d2f88-7cce-43a9-815a-73b4f54f8c9b tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:49.100321 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-005d2f88-7cce-43a9-815a-73b4f54f8c9b tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1507 microversion: 2.1 time: 0.199794 Dec 16 15:51:49.101109 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 239/529] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:48 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1507 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:49.249040 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-476b6075-a647-402b-9bb8-a6a032425c53 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:49.249695 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-476b6075-a647-402b-9bb8-a6a032425c53 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:49.255694 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-476b6075-a647-402b-9bb8-a6a032425c53 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:49.256129 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-476b6075-a647-402b-9bb8-a6a032425c53 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:49.256899 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-476b6075-a647-402b-9bb8-a6a032425c53 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:49.257325 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-476b6075-a647-402b-9bb8-a6a032425c53 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:49.498841 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-476b6075-a647-402b-9bb8-a6a032425c53 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:49.507525 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-476b6075-a647-402b-9bb8-a6a032425c53 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1721 microversion: 2.1 time: 0.262169 Dec 16 15:51:49.508086 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 240/530] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:49 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1721 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:51:49.512399 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-2876e2b9-c23c-415c-998b-ef5e5a8d06eb tempest-VolumesGetTestJSON-47721429 tempest-VolumesGetTestJSON-47721429-project] Calling method '.version_select at 0x7fed5dff01f0>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:49.526409 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-18f10974-18f7-4f81-a027-340dbd25bf2b tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Flavor limits 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 15:51:49.526867 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-18f10974-18f7-4f81-a027-340dbd25bf2b tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Image limits 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 15:51:49.527706 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-18f10974-18f7-4f81-a027-340dbd25bf2b tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Flavor pref 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 15:51:49.528174 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-18f10974-18f7-4f81-a027-340dbd25bf2b tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Image pref 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 15:51:49.528681 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-18f10974-18f7-4f81-a027-340dbd25bf2b tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 15:51:49.538284 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-18f10974-18f7-4f81-a027-340dbd25bf2b tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:49.538825 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-18f10974-18f7-4f81-a027-340dbd25bf2b tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:49.539724 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-18f10974-18f7-4f81-a027-340dbd25bf2b tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:49.540217 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-18f10974-18f7-4f81-a027-340dbd25bf2b tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:49.556970 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-18f10974-18f7-4f81-a027-340dbd25bf2b tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Getting quotas for project 34de311402354bb6a5903e764e3a0cbc. Resources: {'instances', 'ram', 'cores'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:51:49.561725 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-2876e2b9-c23c-415c-998b-ef5e5a8d06eb tempest-VolumesGetTestJSON-47721429 tempest-VolumesGetTestJSON-47721429-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/bf8c0e2f-51ff-4483-9757-45212113f857" status: 200 len: 353 microversion: 2.1 time: 0.052567 Dec 16 15:51:49.562103 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-18f10974-18f7-4f81-a027-340dbd25bf2b tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Getting quotas for user 75f0340818bf4c5a94fa2ae5c4073625 and project 34de311402354bb6a5903e764e3a0cbc. Resources: {'instances', 'ram', 'cores'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:51:49.568312 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 241/531] 10.222.0.31 () {58 vars in 1244 bytes} [Thu Dec 16 15:51:49 2021] GET /compute/v2.1/os-volumes/bf8c0e2f-51ff-4483-9757-45212113f857 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:51:49.568879 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-554b4402-7b93-4a3f-885e-05f0f3b341cd tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:49.569528 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-554b4402-7b93-4a3f-885e-05f0f3b341cd tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 5ff7d8ab-5af0-4a1f-a362-c6d43d7492be] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:49.575367 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-554b4402-7b93-4a3f-885e-05f0f3b341cd tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:49.575812 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-554b4402-7b93-4a3f-885e-05f0f3b341cd tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:49.576595 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-554b4402-7b93-4a3f-885e-05f0f3b341cd tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:49.577027 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-554b4402-7b93-4a3f-885e-05f0f3b341cd tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:49.618724 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-18f10974-18f7-4f81-a027-340dbd25bf2b tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Going to run 1 instances... {{(pid=122399) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 15:51:49.620889 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-18f10974-18f7-4f81-a027-340dbd25bf2b tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f4b8cccf-1a1b-4a46-a53d-99871bc79642',volume_size=None,volume_type=None)] {{(pid=122399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 15:51:49.714501 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-554b4402-7b93-4a3f-885e-05f0f3b341cd tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724c34ba12d8461fa8093c2f617f2755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7aae25eb2ad4219aff78b5f9150925f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:49.722201 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-554b4402-7b93-4a3f-885e-05f0f3b341cd tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "GET /compute/v2.1/servers/5ff7d8ab-5af0-4a1f-a362-c6d43d7492be" status: 200 len: 1314 microversion: 2.1 time: 0.158921 Dec 16 15:51:49.722820 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 242/532] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:49 2021] GET /compute/v2.1/servers/5ff7d8ab-5af0-4a1f-a362-c6d43d7492be => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:49.727533 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-bb229425-c4ab-425c-b25e-6aad8c315cf4 tempest-VolumesGetTestJSON-47721429 tempest-VolumesGetTestJSON-47721429-project] Calling method '.version_select at 0x7fed5df27670>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:49.757281 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-18f10974-18f7-4f81-a027-340dbd25bf2b tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.828688 Dec 16 15:51:49.763181 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 291/533] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Dec 16 15:51:48 2021] POST /compute/v2.1/servers => generated 406 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 16 15:51:49.768526 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-18535ac0-d61b-44a8-870f-f858c88aed10 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:49.769133 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-18535ac0-d61b-44a8-870f-f858c88aed10 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:49.774111 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-bb229425-c4ab-425c-b25e-6aad8c315cf4 tempest-VolumesGetTestJSON-47721429 tempest-VolumesGetTestJSON-47721429-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/bf8c0e2f-51ff-4483-9757-45212113f857" status: 200 len: 353 microversion: 2.1 time: 0.050009 Dec 16 15:51:49.774692 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 243/534] 10.222.0.31 () {58 vars in 1244 bytes} [Thu Dec 16 15:51:49 2021] GET /compute/v2.1/os-volumes/bf8c0e2f-51ff-4483-9757-45212113f857 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:51:49.790283 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-8f04a9d3-93b7-4bbb-8fcd-79356644d352 tempest-VolumesGetTestJSON-47721429 tempest-VolumesGetTestJSON-47721429-project] Calling method '.version_select at 0x7fed5dfd35e0>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:49.831079 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-18535ac0-d61b-44a8-870f-f858c88aed10 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:49.838192 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-18535ac0-d61b-44a8-870f-f858c88aed10 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1089 microversion: 2.1 time: 0.073208 Dec 16 15:51:49.838783 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 292/535] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:49 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1089 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:49.856520 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-8f04a9d3-93b7-4bbb-8fcd-79356644d352 tempest-VolumesGetTestJSON-47721429 tempest-VolumesGetTestJSON-47721429-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/bf8c0e2f-51ff-4483-9757-45212113f857" status: 202 len: 0 microversion: 2.1 time: 0.069739 Dec 16 15:51:49.857428 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 244/536] 10.222.0.31 () {58 vars in 1247 bytes} [Thu Dec 16 15:51:49 2021] DELETE /compute/v2.1/os-volumes/bf8c0e2f-51ff-4483-9757-45212113f857 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:51:49.865455 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-8700ddfb-ce47-43d5-aa67-4e52db2735e5 tempest-VolumesGetTestJSON-47721429 tempest-VolumesGetTestJSON-47721429-project] Calling method '.version_select at 0x7fed5e019c10>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:49.921744 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-8700ddfb-ce47-43d5-aa67-4e52db2735e5 tempest-VolumesGetTestJSON-47721429 tempest-VolumesGetTestJSON-47721429-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/bf8c0e2f-51ff-4483-9757-45212113f857" status: 200 len: 352 microversion: 2.1 time: 0.059756 Dec 16 15:51:49.928292 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 293/537] 10.222.0.31 () {58 vars in 1244 bytes} [Thu Dec 16 15:51:49 2021] GET /compute/v2.1/os-volumes/bf8c0e2f-51ff-4483-9757-45212113f857 => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:51:50.117426 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-10496903-e089-47c0-b659-58f276f7c771 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:50.118157 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-10496903-e089-47c0-b659-58f276f7c771 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:50.130996 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-10496903-e089-47c0-b659-58f276f7c771 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:50.131447 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-10496903-e089-47c0-b659-58f276f7c771 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:50.132234 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-10496903-e089-47c0-b659-58f276f7c771 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:50.132888 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-10496903-e089-47c0-b659-58f276f7c771 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:50.272749 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-10496903-e089-47c0-b659-58f276f7c771 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:50.281557 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-10496903-e089-47c0-b659-58f276f7c771 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1507 microversion: 2.1 time: 0.168520 Dec 16 15:51:50.282148 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 245/538] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:50 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:50.524472 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-8363da8a-0146-46a3-8ddc-18ecc139a530 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:50.525231 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-8363da8a-0146-46a3-8ddc-18ecc139a530 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:50.540006 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8363da8a-0146-46a3-8ddc-18ecc139a530 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:50.541447 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8363da8a-0146-46a3-8ddc-18ecc139a530 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:50.542478 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8363da8a-0146-46a3-8ddc-18ecc139a530 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:50.543161 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8363da8a-0146-46a3-8ddc-18ecc139a530 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:50.694364 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-8363da8a-0146-46a3-8ddc-18ecc139a530 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:50.702377 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-8363da8a-0146-46a3-8ddc-18ecc139a530 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1721 microversion: 2.1 time: 0.182112 Dec 16 15:51:50.703126 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 294/539] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:50 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:50.738590 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-cb9dd727-0b49-4bfd-b9e9-b25cb3f6add5 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:50.739184 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-cb9dd727-0b49-4bfd-b9e9-b25cb3f6add5 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 5ff7d8ab-5af0-4a1f-a362-c6d43d7492be] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:50.745911 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cb9dd727-0b49-4bfd-b9e9-b25cb3f6add5 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:50.746543 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cb9dd727-0b49-4bfd-b9e9-b25cb3f6add5 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:50.747574 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cb9dd727-0b49-4bfd-b9e9-b25cb3f6add5 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:50.748199 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cb9dd727-0b49-4bfd-b9e9-b25cb3f6add5 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:50.855909 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-99b0e782-635d-491c-a725-9a79a763fb5f tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:50.856515 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-99b0e782-635d-491c-a725-9a79a763fb5f tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:50.876334 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-99b0e782-635d-491c-a725-9a79a763fb5f tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:50.876926 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-99b0e782-635d-491c-a725-9a79a763fb5f tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:50.888823 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-99b0e782-635d-491c-a725-9a79a763fb5f tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:50.892463 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-99b0e782-635d-491c-a725-9a79a763fb5f tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:50.925425 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-cb9dd727-0b49-4bfd-b9e9-b25cb3f6add5 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724c34ba12d8461fa8093c2f617f2755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7aae25eb2ad4219aff78b5f9150925f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:50.939264 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-cb9dd727-0b49-4bfd-b9e9-b25cb3f6add5 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "GET /compute/v2.1/servers/5ff7d8ab-5af0-4a1f-a362-c6d43d7492be" status: 200 len: 1314 microversion: 2.1 time: 0.204284 Dec 16 15:51:50.951135 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 246/540] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:50 2021] GET /compute/v2.1/servers/5ff7d8ab-5af0-4a1f-a362-c6d43d7492be => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:50.957722 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-1703b09a-6596-48bb-b311-0708b3708fd1 tempest-VolumesGetTestJSON-47721429 tempest-VolumesGetTestJSON-47721429-project] Calling method '.version_select at 0x7fed5df4a1f0>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:51.003214 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-99b0e782-635d-491c-a725-9a79a763fb5f tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:51.006937 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.wsgi [None req-1703b09a-6596-48bb-b311-0708b3708fd1 tempest-VolumesGetTestJSON-47721429 tempest-VolumesGetTestJSON-47721429-project] HTTP exception thrown: Volume bf8c0e2f-51ff-4483-9757-45212113f857 could not be found. Dec 16 15:51:51.008115 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-1703b09a-6596-48bb-b311-0708b3708fd1 tempest-VolumesGetTestJSON-47721429 tempest-VolumesGetTestJSON-47721429-project] Returning 404 to user: Volume bf8c0e2f-51ff-4483-9757-45212113f857 could not be found. {{(pid=122398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:51:51.009248 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-1703b09a-6596-48bb-b311-0708b3708fd1 tempest-VolumesGetTestJSON-47721429 tempest-VolumesGetTestJSON-47721429-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/bf8c0e2f-51ff-4483-9757-45212113f857" status: 404 len: 109 microversion: 2.1 time: 0.057069 Dec 16 15:51:51.010098 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 247/541] 10.222.0.31 () {58 vars in 1244 bytes} [Thu Dec 16 15:51:50 2021] GET /compute/v2.1/os-volumes/bf8c0e2f-51ff-4483-9757-45212113f857 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:51:51.016320 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-99b0e782-635d-491c-a725-9a79a763fb5f tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1205 microversion: 2.1 time: 0.164305 Dec 16 15:51:51.018596 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 295/542] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:50 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1205 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:51:51.152533 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-91082049-9c3c-44ae-b746-489c79e115f2 req-9411efe1-c752-4320-911c-6f94ab75f095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce6f3e72-0124-4937-9016-c13d65d07acd", "name": "network-vif-deleted", "tag": "cc1f207a-64d8-409d-a59e-543c8d2230c6"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:51.155404 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:51:51.155404 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:51:51.164275 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-91082049-9c3c-44ae-b746-489c79e115f2 req-9411efe1-c752-4320-911c-6f94ab75f095 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:51.164905 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-91082049-9c3c-44ae-b746-489c79e115f2 req-9411efe1-c752-4320-911c-6f94ab75f095 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:51.177089 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-91082049-9c3c-44ae-b746-489c79e115f2 req-9411efe1-c752-4320-911c-6f94ab75f095 service nova] Creating event network-vif-deleted:cc1f207a-64d8-409d-a59e-543c8d2230c6 for instance ce6f3e72-0124-4937-9016-c13d65d07acd on hv-cinder-78447 Dec 16 15:51:51.183368 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-91082049-9c3c-44ae-b746-489c79e115f2 req-9411efe1-c752-4320-911c-6f94ab75f095 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034972 Dec 16 15:51:51.184178 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 248/543] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:51:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:51:51.298641 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-6fd5a53f-e4e8-45e8-9a76-0290a085daa1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:51.299204 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-6fd5a53f-e4e8-45e8-9a76-0290a085daa1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:51.307761 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6fd5a53f-e4e8-45e8-9a76-0290a085daa1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:51.308257 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6fd5a53f-e4e8-45e8-9a76-0290a085daa1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:51.309251 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6fd5a53f-e4e8-45e8-9a76-0290a085daa1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:51.309802 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6fd5a53f-e4e8-45e8-9a76-0290a085daa1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:51.346618 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6fd5a53f-e4e8-45e8-9a76-0290a085daa1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:51.347414 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6fd5a53f-e4e8-45e8-9a76-0290a085daa1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:51.348034 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.objects.instance [None req-6fd5a53f-e4e8-45e8-9a76-0290a085daa1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lazy-loading 'fault' on Instance uuid ce6f3e72-0124-4937-9016-c13d65d07acd {{(pid=122399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:51:51.428668 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-6fd5a53f-e4e8-45e8-9a76-0290a085daa1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:51.437177 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-6fd5a53f-e4e8-45e8-9a76-0290a085daa1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 200 len: 1311 microversion: 2.1 time: 0.142080 Dec 16 15:51:51.447003 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 296/544] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:51 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 1311 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:51.727178 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-b3d89b51-18cb-48d1-86bd-d58ca09fa8b4 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:51.728345 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-b3d89b51-18cb-48d1-86bd-d58ca09fa8b4 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:51.744153 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b3d89b51-18cb-48d1-86bd-d58ca09fa8b4 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:51.745650 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b3d89b51-18cb-48d1-86bd-d58ca09fa8b4 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:51.747118 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b3d89b51-18cb-48d1-86bd-d58ca09fa8b4 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:51.747784 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b3d89b51-18cb-48d1-86bd-d58ca09fa8b4 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:51.955272 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-b3d89b51-18cb-48d1-86bd-d58ca09fa8b4 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:51.961025 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-6ba6ad52-d111-4fcc-ba0d-8343cf227942 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:51.966949 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-6ba6ad52-d111-4fcc-ba0d-8343cf227942 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 5ff7d8ab-5af0-4a1f-a362-c6d43d7492be] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:51.975367 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-b3d89b51-18cb-48d1-86bd-d58ca09fa8b4 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1698 microversion: 2.1 time: 0.258959 Dec 16 15:51:51.975964 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 249/545] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:51 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1698 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:51:51.990843 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6ba6ad52-d111-4fcc-ba0d-8343cf227942 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:51.991709 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-3bc2f226-8083-40da-a109-01a9e9585040 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:51.998109 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3bc2f226-8083-40da-a109-01a9e9585040 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:51.998439 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6ba6ad52-d111-4fcc-ba0d-8343cf227942 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:51.998591 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3bc2f226-8083-40da-a109-01a9e9585040 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:51.999593 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6ba6ad52-d111-4fcc-ba0d-8343cf227942 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:52.000189 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6ba6ad52-d111-4fcc-ba0d-8343cf227942 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:52.032502 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-3bc2f226-8083-40da-a109-01a9e9585040 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Going to try to start instance {{(pid=122398) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 16 15:51:52.113850 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-3bc2f226-8083-40da-a109-01a9e9585040 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 202 len: 0 microversion: 2.1 time: 0.123561 Dec 16 15:51:52.116806 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 250/546] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:51:51 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 16 15:51:52.139806 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-c1e4b778-ef57-4568-930d-00f277836501 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:52.141013 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-c1e4b778-ef57-4568-930d-00f277836501 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:52.155927 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c1e4b778-ef57-4568-930d-00f277836501 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:52.156601 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c1e4b778-ef57-4568-930d-00f277836501 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:52.157202 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c1e4b778-ef57-4568-930d-00f277836501 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:52.157874 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c1e4b778-ef57-4568-930d-00f277836501 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:52.323939 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-6ba6ad52-d111-4fcc-ba0d-8343cf227942 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724c34ba12d8461fa8093c2f617f2755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7aae25eb2ad4219aff78b5f9150925f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:52.344295 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-6ba6ad52-d111-4fcc-ba0d-8343cf227942 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "GET /compute/v2.1/servers/5ff7d8ab-5af0-4a1f-a362-c6d43d7492be" status: 200 len: 1314 microversion: 2.1 time: 0.381452 Dec 16 15:51:52.346959 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 297/547] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:51 2021] GET /compute/v2.1/servers/5ff7d8ab-5af0-4a1f-a362-c6d43d7492be => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:52.359707 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-cc36d7b4-97f5-4d3f-ae29-ec4c2f517297 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:52.360587 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-cc36d7b4-97f5-4d3f-ae29-ec4c2f517297 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:52.371419 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-cc36d7b4-97f5-4d3f-ae29-ec4c2f517297 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:52.372061 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-cc36d7b4-97f5-4d3f-ae29-ec4c2f517297 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:52.373350 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-cc36d7b4-97f5-4d3f-ae29-ec4c2f517297 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:52.375522 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-cc36d7b4-97f5-4d3f-ae29-ec4c2f517297 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:52.402729 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-c1e4b778-ef57-4568-930d-00f277836501 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:52.416630 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-c1e4b778-ef57-4568-930d-00f277836501 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1261 microversion: 2.1 time: 0.298181 Dec 16 15:51:52.417941 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 251/548] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:52 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1261 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:52.469333 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-cceac927-caa1-44fe-af62-e000870c30c1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:52.470823 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-cceac927-caa1-44fe-af62-e000870c30c1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: ce6f3e72-0124-4937-9016-c13d65d07acd] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:52.489341 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cceac927-caa1-44fe-af62-e000870c30c1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:52.490187 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cceac927-caa1-44fe-af62-e000870c30c1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:52.491370 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cceac927-caa1-44fe-af62-e000870c30c1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:52.492046 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cceac927-caa1-44fe-af62-e000870c30c1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:52.527504 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.wsgi [None req-cceac927-caa1-44fe-af62-e000870c30c1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] HTTP exception thrown: Instance ce6f3e72-0124-4937-9016-c13d65d07acd could not be found. Dec 16 15:51:52.528218 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-cceac927-caa1-44fe-af62-e000870c30c1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Returning 404 to user: Instance ce6f3e72-0124-4937-9016-c13d65d07acd could not be found. {{(pid=122398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:51:52.529133 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-cceac927-caa1-44fe-af62-e000870c30c1 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd" status: 404 len: 111 microversion: 2.1 time: 0.078216 Dec 16 15:51:52.530332 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 252/549] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:52 2021] GET /compute/v2.1/servers/ce6f3e72-0124-4937-9016-c13d65d07acd => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:51:52.539567 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-594f13b9-a56c-4c81-a92d-b3987d03e84e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:52.540508 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-594f13b9-a56c-4c81-a92d-b3987d03e84e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:52.549201 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-594f13b9-a56c-4c81-a92d-b3987d03e84e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:52.549890 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-594f13b9-a56c-4c81-a92d-b3987d03e84e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:52.551408 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-594f13b9-a56c-4c81-a92d-b3987d03e84e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:52.552063 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-594f13b9-a56c-4c81-a92d-b3987d03e84e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:52.595425 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-594f13b9-a56c-4c81-a92d-b3987d03e84e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Going to try to terminate instance {{(pid=122398) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 15:51:52.610614 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-cc36d7b4-97f5-4d3f-ae29-ec4c2f517297 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:52.623281 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-cc36d7b4-97f5-4d3f-ae29-ec4c2f517297 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1707 microversion: 2.1 time: 0.274437 Dec 16 15:51:52.624837 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 298/550] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:52 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1707 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:52.727532 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-56cee68e-32c5-4391-8018-6386d548e550 req-31818eec-e76f-4a73-b758-9824b303ce1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff7d8ab-5af0-4a1f-a362-c6d43d7492be", "name": "network-vif-plugged", "status": "completed", "tag": "9e7221ff-5d9d-4ed8-8500-cccc65e2b928"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:52.729540 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:51:52.729540 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:51:52.747058 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-56cee68e-32c5-4391-8018-6386d548e550 req-31818eec-e76f-4a73-b758-9824b303ce1b service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:52.747903 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-56cee68e-32c5-4391-8018-6386d548e550 req-31818eec-e76f-4a73-b758-9824b303ce1b service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:52.756121 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-594f13b9-a56c-4c81-a92d-b3987d03e84e tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "DELETE /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 204 len: 0 microversion: 2.1 time: 0.221260 Dec 16 15:51:52.758182 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 253/551] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Dec 16 15:51:52 2021] DELETE /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:51:52.763287 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-56cee68e-32c5-4391-8018-6386d548e550 req-31818eec-e76f-4a73-b758-9824b303ce1b service nova] Creating event network-vif-plugged:9e7221ff-5d9d-4ed8-8500-cccc65e2b928 for instance 5ff7d8ab-5af0-4a1f-a362-c6d43d7492be on hv-cinder-78447 Dec 16 15:51:52.768015 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-e0a6d357-89c8-4645-8785-143b9630b111 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:52.769155 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-e0a6d357-89c8-4645-8785-143b9630b111 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:52.770065 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-56cee68e-32c5-4391-8018-6386d548e550 req-31818eec-e76f-4a73-b758-9824b303ce1b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054507 Dec 16 15:51:52.771787 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 299/552] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:51:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:51:52.776444 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e0a6d357-89c8-4645-8785-143b9630b111 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:52.777114 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e0a6d357-89c8-4645-8785-143b9630b111 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:52.778131 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e0a6d357-89c8-4645-8785-143b9630b111 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:52.778761 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e0a6d357-89c8-4645-8785-143b9630b111 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:52.970766 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-e0a6d357-89c8-4645-8785-143b9630b111 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:52.980323 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-e0a6d357-89c8-4645-8785-143b9630b111 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.218084 Dec 16 15:51:52.980914 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 254/553] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:52 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:51:53.247752 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-e27afa71-adbc-4fb3-bef1-cd0079967bdd req-d3ee25b4-7eb4-41d4-bc62-4d7155644984 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "248b8eac-f030-4761-a6c9-0ddaf6475f0f", "tag": "8e2fdbb4-3edf-41eb-8daa-904ea54bacb1"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:53.250993 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:51:53.250993 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:51:53.260828 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-e27afa71-adbc-4fb3-bef1-cd0079967bdd req-d3ee25b4-7eb4-41d4-bc62-4d7155644984 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:53.261717 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-e27afa71-adbc-4fb3-bef1-cd0079967bdd req-d3ee25b4-7eb4-41d4-bc62-4d7155644984 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:53.272884 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-e27afa71-adbc-4fb3-bef1-cd0079967bdd req-d3ee25b4-7eb4-41d4-bc62-4d7155644984 service nova] Creating event network-changed:8e2fdbb4-3edf-41eb-8daa-904ea54bacb1 for instance 248b8eac-f030-4761-a6c9-0ddaf6475f0f on hv-cinder-78447 Dec 16 15:51:53.277851 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-e27afa71-adbc-4fb3-bef1-cd0079967bdd req-d3ee25b4-7eb4-41d4-bc62-4d7155644984 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035960 Dec 16 15:51:53.278444 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 300/554] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:51:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:51:53.362777 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-2802a0de-ae5b-4421-8971-43871417502f tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:53.363398 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-2802a0de-ae5b-4421-8971-43871417502f tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 5ff7d8ab-5af0-4a1f-a362-c6d43d7492be] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:53.369982 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2802a0de-ae5b-4421-8971-43871417502f tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:53.370419 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2802a0de-ae5b-4421-8971-43871417502f tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:53.371218 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2802a0de-ae5b-4421-8971-43871417502f tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:53.371644 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2802a0de-ae5b-4421-8971-43871417502f tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:53.434735 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-bd731f39-f52a-4e4f-99c3-7eddc8dd9ad9 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:53.435590 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-bd731f39-f52a-4e4f-99c3-7eddc8dd9ad9 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:53.442066 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-bd731f39-f52a-4e4f-99c3-7eddc8dd9ad9 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:53.442509 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-bd731f39-f52a-4e4f-99c3-7eddc8dd9ad9 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:53.443306 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-bd731f39-f52a-4e4f-99c3-7eddc8dd9ad9 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:53.443736 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-bd731f39-f52a-4e4f-99c3-7eddc8dd9ad9 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:53.693898 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-2802a0de-ae5b-4421-8971-43871417502f tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724c34ba12d8461fa8093c2f617f2755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7aae25eb2ad4219aff78b5f9150925f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:53.702464 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-2802a0de-ae5b-4421-8971-43871417502f tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "GET /compute/v2.1/servers/5ff7d8ab-5af0-4a1f-a362-c6d43d7492be" status: 200 len: 1314 microversion: 2.1 time: 0.342969 Dec 16 15:51:53.711675 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 255/555] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:53 2021] GET /compute/v2.1/servers/5ff7d8ab-5af0-4a1f-a362-c6d43d7492be => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:53.711675 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-29527f34-3ed2-44f5-8107-610992617af2 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:53.711937 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-29527f34-3ed2-44f5-8107-610992617af2 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:53.717246 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-bd731f39-f52a-4e4f-99c3-7eddc8dd9ad9 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:53.717880 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-29527f34-3ed2-44f5-8107-610992617af2 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:53.718342 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-29527f34-3ed2-44f5-8107-610992617af2 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:53.719156 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-29527f34-3ed2-44f5-8107-610992617af2 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:53.719791 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-29527f34-3ed2-44f5-8107-610992617af2 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:53.726900 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-bd731f39-f52a-4e4f-99c3-7eddc8dd9ad9 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1261 microversion: 2.1 time: 0.296167 Dec 16 15:51:53.727958 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 301/556] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:53 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1261 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:51:53.895747 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-29527f34-3ed2-44f5-8107-610992617af2 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:53.903783 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-29527f34-3ed2-44f5-8107-610992617af2 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1707 microversion: 2.1 time: 0.198004 Dec 16 15:51:53.904355 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 256/557] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:53 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1707 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:53.997861 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-1f35a1a7-8e2d-4f39-b890-2a2da58c8b31 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:53.998743 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-1f35a1a7-8e2d-4f39-b890-2a2da58c8b31 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:54.004926 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1f35a1a7-8e2d-4f39-b890-2a2da58c8b31 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:54.005383 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1f35a1a7-8e2d-4f39-b890-2a2da58c8b31 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:54.006199 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1f35a1a7-8e2d-4f39-b890-2a2da58c8b31 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:54.006632 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1f35a1a7-8e2d-4f39-b890-2a2da58c8b31 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:54.228682 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-1f35a1a7-8e2d-4f39-b890-2a2da58c8b31 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:54.255179 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-1f35a1a7-8e2d-4f39-b890-2a2da58c8b31 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.257694 Dec 16 15:51:54.262296 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 302/558] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:53 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:54.719929 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-491b5bce-a117-47b7-b2af-7fb2b5956a49 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:54.720674 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-491b5bce-a117-47b7-b2af-7fb2b5956a49 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 5ff7d8ab-5af0-4a1f-a362-c6d43d7492be] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:54.727225 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-491b5bce-a117-47b7-b2af-7fb2b5956a49 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:54.727682 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-491b5bce-a117-47b7-b2af-7fb2b5956a49 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:54.728447 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-491b5bce-a117-47b7-b2af-7fb2b5956a49 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:54.728851 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-491b5bce-a117-47b7-b2af-7fb2b5956a49 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:54.744239 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-189cec48-bb44-41b1-b5f5-95e5bf3b1c80 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:54.745269 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-189cec48-bb44-41b1-b5f5-95e5bf3b1c80 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:54.753201 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-189cec48-bb44-41b1-b5f5-95e5bf3b1c80 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:54.753780 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-189cec48-bb44-41b1-b5f5-95e5bf3b1c80 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:54.754816 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-189cec48-bb44-41b1-b5f5-95e5bf3b1c80 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:54.755308 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-189cec48-bb44-41b1-b5f5-95e5bf3b1c80 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:55.216728 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-491b5bce-a117-47b7-b2af-7fb2b5956a49 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724c34ba12d8461fa8093c2f617f2755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7aae25eb2ad4219aff78b5f9150925f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:55.232018 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-491b5bce-a117-47b7-b2af-7fb2b5956a49 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "GET /compute/v2.1/servers/5ff7d8ab-5af0-4a1f-a362-c6d43d7492be" status: 200 len: 1498 microversion: 2.1 time: 0.516479 Dec 16 15:51:55.244368 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 257/559] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:54 2021] GET /compute/v2.1/servers/5ff7d8ab-5af0-4a1f-a362-c6d43d7492be => generated 1498 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:55.252137 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-189cec48-bb44-41b1-b5f5-95e5bf3b1c80 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:55.262116 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-189cec48-bb44-41b1-b5f5-95e5bf3b1c80 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1261 microversion: 2.1 time: 0.522158 Dec 16 15:51:55.263892 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 303/560] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:54 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1261 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:55.265191 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-725f7c54-5874-4fc3-a400-731044ccadaa tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:55.267840 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-725f7c54-5874-4fc3-a400-731044ccadaa tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:55.278473 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-3612ae8a-cd51-4c36-a071-efdc3f224b73 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:55.279110 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-3612ae8a-cd51-4c36-a071-efdc3f224b73 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:55.279473 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-725f7c54-5874-4fc3-a400-731044ccadaa tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:55.280080 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-725f7c54-5874-4fc3-a400-731044ccadaa tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:55.281231 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-725f7c54-5874-4fc3-a400-731044ccadaa tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:55.282278 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-725f7c54-5874-4fc3-a400-731044ccadaa tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:55.299884 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3612ae8a-cd51-4c36-a071-efdc3f224b73 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:55.300706 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3612ae8a-cd51-4c36-a071-efdc3f224b73 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:55.301831 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3612ae8a-cd51-4c36-a071-efdc3f224b73 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:55.302354 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3612ae8a-cd51-4c36-a071-efdc3f224b73 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:55.512299 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-725f7c54-5874-4fc3-a400-731044ccadaa tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:55.521724 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-3612ae8a-cd51-4c36-a071-efdc3f224b73 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:55.531551 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-725f7c54-5874-4fc3-a400-731044ccadaa tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1711 microversion: 2.1 time: 0.285820 Dec 16 15:51:55.533442 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-3612ae8a-cd51-4c36-a071-efdc3f224b73 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.263914 Dec 16 15:51:55.534268 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 304/561] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:55 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:55.535041 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 258/562] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:55 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1711 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:55.760668 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-764c498f-826c-47c5-be4e-851e5fd3be29 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:55.761159 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-764c498f-826c-47c5-be4e-851e5fd3be29 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 5ff7d8ab-5af0-4a1f-a362-c6d43d7492be] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:55.767326 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-764c498f-826c-47c5-be4e-851e5fd3be29 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:55.767767 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-764c498f-826c-47c5-be4e-851e5fd3be29 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:55.768541 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-764c498f-826c-47c5-be4e-851e5fd3be29 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:55.768974 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-764c498f-826c-47c5-be4e-851e5fd3be29 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:55.793367 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-764c498f-826c-47c5-be4e-851e5fd3be29 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 5ff7d8ab-5af0-4a1f-a362-c6d43d7492be] Going to try to terminate instance {{(pid=122399) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 15:51:55.871170 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-764c498f-826c-47c5-be4e-851e5fd3be29 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "DELETE /compute/v2.1/servers/5ff7d8ab-5af0-4a1f-a362-c6d43d7492be" status: 204 len: 0 microversion: 2.1 time: 0.113859 Dec 16 15:51:55.873443 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 305/563] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Dec 16 15:51:55 2021] DELETE /compute/v2.1/servers/5ff7d8ab-5af0-4a1f-a362-c6d43d7492be => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:51:55.879726 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-5e962135-3a05-4acd-bbc4-d7804a4b5a79 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:55.880563 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-5e962135-3a05-4acd-bbc4-d7804a4b5a79 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 5ff7d8ab-5af0-4a1f-a362-c6d43d7492be] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:55.887029 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5e962135-3a05-4acd-bbc4-d7804a4b5a79 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:55.887470 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5e962135-3a05-4acd-bbc4-d7804a4b5a79 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:55.888369 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5e962135-3a05-4acd-bbc4-d7804a4b5a79 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:55.888776 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5e962135-3a05-4acd-bbc4-d7804a4b5a79 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:56.021378 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-5e962135-3a05-4acd-bbc4-d7804a4b5a79 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724c34ba12d8461fa8093c2f617f2755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7aae25eb2ad4219aff78b5f9150925f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:56.029226 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-5e962135-3a05-4acd-bbc4-d7804a4b5a79 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "GET /compute/v2.1/servers/5ff7d8ab-5af0-4a1f-a362-c6d43d7492be" status: 200 len: 1504 microversion: 2.1 time: 0.153236 Dec 16 15:51:56.029831 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 259/564] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:55 2021] GET /compute/v2.1/servers/5ff7d8ab-5af0-4a1f-a362-c6d43d7492be => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:56.280859 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-320cec48-8a3d-4cd6-aa56-994e648e9d9e tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:56.281588 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-320cec48-8a3d-4cd6-aa56-994e648e9d9e tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:56.287907 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-320cec48-8a3d-4cd6-aa56-994e648e9d9e tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:56.288348 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-320cec48-8a3d-4cd6-aa56-994e648e9d9e tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:56.289125 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-320cec48-8a3d-4cd6-aa56-994e648e9d9e tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:56.289591 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-320cec48-8a3d-4cd6-aa56-994e648e9d9e tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:56.426979 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-320cec48-8a3d-4cd6-aa56-994e648e9d9e tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:56.434544 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-320cec48-8a3d-4cd6-aa56-994e648e9d9e tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1261 microversion: 2.1 time: 0.158012 Dec 16 15:51:56.437625 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 306/565] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:56 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:56.550466 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-4b0f99d3-8807-4fbc-bd75-83a49b927e8d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:56.551078 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-4b0f99d3-8807-4fbc-bd75-83a49b927e8d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:56.556909 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4b0f99d3-8807-4fbc-bd75-83a49b927e8d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:56.557351 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4b0f99d3-8807-4fbc-bd75-83a49b927e8d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:56.558152 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4b0f99d3-8807-4fbc-bd75-83a49b927e8d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:56.558577 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4b0f99d3-8807-4fbc-bd75-83a49b927e8d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:56.687547 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-4b0f99d3-8807-4fbc-bd75-83a49b927e8d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:56.694877 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-4b0f99d3-8807-4fbc-bd75-83a49b927e8d tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.148100 Dec 16 15:51:56.695436 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 260/566] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:56 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:57.047389 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-a90567de-7804-42dc-9486-2a63e936ad61 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:57.048123 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-a90567de-7804-42dc-9486-2a63e936ad61 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 5ff7d8ab-5af0-4a1f-a362-c6d43d7492be] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:57.054475 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a90567de-7804-42dc-9486-2a63e936ad61 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:57.054917 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a90567de-7804-42dc-9486-2a63e936ad61 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:57.055685 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a90567de-7804-42dc-9486-2a63e936ad61 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:57.056108 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a90567de-7804-42dc-9486-2a63e936ad61 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:57.190660 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-a90567de-7804-42dc-9486-2a63e936ad61 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724c34ba12d8461fa8093c2f617f2755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7aae25eb2ad4219aff78b5f9150925f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:57.198377 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-a90567de-7804-42dc-9486-2a63e936ad61 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "GET /compute/v2.1/servers/5ff7d8ab-5af0-4a1f-a362-c6d43d7492be" status: 200 len: 1504 microversion: 2.1 time: 0.154618 Dec 16 15:51:57.198978 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 307/567] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:57 2021] GET /compute/v2.1/servers/5ff7d8ab-5af0-4a1f-a362-c6d43d7492be => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:57.451531 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-a203a584-dc2c-4443-b9ee-005921561a95 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:57.452100 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-a203a584-dc2c-4443-b9ee-005921561a95 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:57.458777 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a203a584-dc2c-4443-b9ee-005921561a95 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:57.459233 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a203a584-dc2c-4443-b9ee-005921561a95 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:57.460000 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a203a584-dc2c-4443-b9ee-005921561a95 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:57.460428 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a203a584-dc2c-4443-b9ee-005921561a95 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:57.618146 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-a203a584-dc2c-4443-b9ee-005921561a95 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:57.631453 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-a203a584-dc2c-4443-b9ee-005921561a95 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1261 microversion: 2.1 time: 0.183533 Dec 16 15:51:57.632662 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 261/568] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:57 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1261 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:57.711711 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-1c654911-a2b5-48be-ab68-b170e16872d4 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:57.712273 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-1c654911-a2b5-48be-ab68-b170e16872d4 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:57.718562 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1c654911-a2b5-48be-ab68-b170e16872d4 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:57.719018 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1c654911-a2b5-48be-ab68-b170e16872d4 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:57.719802 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1c654911-a2b5-48be-ab68-b170e16872d4 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:57.720236 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1c654911-a2b5-48be-ab68-b170e16872d4 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:57.952843 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-1c654911-a2b5-48be-ab68-b170e16872d4 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:57.960316 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-1c654911-a2b5-48be-ab68-b170e16872d4 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.252277 Dec 16 15:51:57.960884 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 308/569] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:57 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:58.119836 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-3d9da3b3-a4aa-4641-9629-4c062f76ed0a req-d1ed7d28-504b-4162-b4c0-354db8d90bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff7d8ab-5af0-4a1f-a362-c6d43d7492be", "name": "network-vif-deleted", "tag": "9e7221ff-5d9d-4ed8-8500-cccc65e2b928"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:58.121389 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:51:58.121389 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:51:58.128858 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-3d9da3b3-a4aa-4641-9629-4c062f76ed0a req-d1ed7d28-504b-4162-b4c0-354db8d90bb6 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:58.129673 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-3d9da3b3-a4aa-4641-9629-4c062f76ed0a req-d1ed7d28-504b-4162-b4c0-354db8d90bb6 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:58.143526 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-3d9da3b3-a4aa-4641-9629-4c062f76ed0a req-d1ed7d28-504b-4162-b4c0-354db8d90bb6 service nova] Creating event network-vif-deleted:9e7221ff-5d9d-4ed8-8500-cccc65e2b928 for instance 5ff7d8ab-5af0-4a1f-a362-c6d43d7492be on hv-cinder-78447 Dec 16 15:51:58.148495 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-3d9da3b3-a4aa-4641-9629-4c062f76ed0a req-d1ed7d28-504b-4162-b4c0-354db8d90bb6 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032234 Dec 16 15:51:58.149101 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 262/570] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:51:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:51:58.215845 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-d58f7e97-36dc-4446-b270-355a149f6ba7 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:58.216445 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-d58f7e97-36dc-4446-b270-355a149f6ba7 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 5ff7d8ab-5af0-4a1f-a362-c6d43d7492be] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:58.222759 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d58f7e97-36dc-4446-b270-355a149f6ba7 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:58.223210 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d58f7e97-36dc-4446-b270-355a149f6ba7 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:58.224502 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d58f7e97-36dc-4446-b270-355a149f6ba7 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:58.224931 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d58f7e97-36dc-4446-b270-355a149f6ba7 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:58.255165 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d58f7e97-36dc-4446-b270-355a149f6ba7 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:58.255608 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d58f7e97-36dc-4446-b270-355a149f6ba7 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:58.256047 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.objects.instance [None req-d58f7e97-36dc-4446-b270-355a149f6ba7 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lazy-loading 'fault' on Instance uuid 5ff7d8ab-5af0-4a1f-a362-c6d43d7492be {{(pid=122399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:51:58.294154 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-d58f7e97-36dc-4446-b270-355a149f6ba7 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724c34ba12d8461fa8093c2f617f2755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7aae25eb2ad4219aff78b5f9150925f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:58.301459 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-d58f7e97-36dc-4446-b270-355a149f6ba7 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "GET /compute/v2.1/servers/5ff7d8ab-5af0-4a1f-a362-c6d43d7492be" status: 200 len: 1304 microversion: 2.1 time: 0.089301 Dec 16 15:51:58.302038 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 309/571] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:58 2021] GET /compute/v2.1/servers/5ff7d8ab-5af0-4a1f-a362-c6d43d7492be => generated 1304 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:58.653265 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-1a52dba7-6ad2-4472-8483-335c997145aa tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:58.654136 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-1a52dba7-6ad2-4472-8483-335c997145aa tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:58.660349 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1a52dba7-6ad2-4472-8483-335c997145aa tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:58.660785 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1a52dba7-6ad2-4472-8483-335c997145aa tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:58.661763 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1a52dba7-6ad2-4472-8483-335c997145aa tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:58.662183 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1a52dba7-6ad2-4472-8483-335c997145aa tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:58.802015 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-1a52dba7-6ad2-4472-8483-335c997145aa tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:58.810094 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-1a52dba7-6ad2-4472-8483-335c997145aa tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1261 microversion: 2.1 time: 0.161806 Dec 16 15:51:58.810654 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 263/572] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:58 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:58.982714 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-72360a39-31e4-401b-99f0-df84080e9f61 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:58.983712 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-72360a39-31e4-401b-99f0-df84080e9f61 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:58.991482 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-72360a39-31e4-401b-99f0-df84080e9f61 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:58.991927 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-72360a39-31e4-401b-99f0-df84080e9f61 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:58.992890 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-72360a39-31e4-401b-99f0-df84080e9f61 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:58.993272 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-72360a39-31e4-401b-99f0-df84080e9f61 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:59.126146 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-72360a39-31e4-401b-99f0-df84080e9f61 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:51:59.133735 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-72360a39-31e4-401b-99f0-df84080e9f61 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1522 microversion: 2.1 time: 0.157390 Dec 16 15:51:59.134292 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 310/573] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:58 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:51:59.322824 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-f61745b7-fd91-457c-b879-cbe29ad3f161 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:59.323874 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-f61745b7-fd91-457c-b879-cbe29ad3f161 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] [instance: 5ff7d8ab-5af0-4a1f-a362-c6d43d7492be] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:59.333217 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f61745b7-fd91-457c-b879-cbe29ad3f161 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:59.333695 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f61745b7-fd91-457c-b879-cbe29ad3f161 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:59.334462 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f61745b7-fd91-457c-b879-cbe29ad3f161 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:59.334892 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f61745b7-fd91-457c-b879-cbe29ad3f161 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:59.348154 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.wsgi [None req-f61745b7-fd91-457c-b879-cbe29ad3f161 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] HTTP exception thrown: Instance 5ff7d8ab-5af0-4a1f-a362-c6d43d7492be could not be found. Dec 16 15:51:59.348740 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-f61745b7-fd91-457c-b879-cbe29ad3f161 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] Returning 404 to user: Instance 5ff7d8ab-5af0-4a1f-a362-c6d43d7492be could not be found. {{(pid=122398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:51:59.349937 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-f61745b7-fd91-457c-b879-cbe29ad3f161 tempest-VolumesActionsTest-572318000 tempest-VolumesActionsTest-572318000-project] 10.222.0.31 "GET /compute/v2.1/servers/5ff7d8ab-5af0-4a1f-a362-c6d43d7492be" status: 404 len: 111 microversion: 2.1 time: 0.033419 Dec 16 15:51:59.350485 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 264/574] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:59 2021] GET /compute/v2.1/servers/5ff7d8ab-5af0-4a1f-a362-c6d43d7492be => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:51:59.643664 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-c88c1a25-d0f7-40b7-bea4-c7aaa0ea59db tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2003886719", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-824262971", "security_groups": [{"name": "tempest-secgroup-smoke-832002217"}], "block_device_mapping_v2": [{"uuid": "0cc0d22d-8207-477e-9b77-bb3e8363f503", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "447cd8ca-a758-4b0d-966f-d4641376c8a8"}]}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:51:59.827578 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-3d1db5c9-8ca0-4212-87d0-56c3cb03aa14 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:51:59.828199 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-3d1db5c9-8ca0-4212-87d0-56c3cb03aa14 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:51:59.846590 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3d1db5c9-8ca0-4212-87d0-56c3cb03aa14 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:59.847424 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3d1db5c9-8ca0-4212-87d0-56c3cb03aa14 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:59.847870 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3d1db5c9-8ca0-4212-87d0-56c3cb03aa14 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:51:59.848293 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3d1db5c9-8ca0-4212-87d0-56c3cb03aa14 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:51:59.860716 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.network.neutron [None req-c88c1a25-d0f7-40b7-bea4-c7aaa0ea59db tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] validate_networks() for [('447cd8ca-a758-4b0d-966f-d4641376c8a8', None, None, None, None, None)] {{(pid=122399) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 15:52:00.127577 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-3d1db5c9-8ca0-4212-87d0-56c3cb03aa14 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:00.137227 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-3d1db5c9-8ca0-4212-87d0-56c3cb03aa14 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1261 microversion: 2.1 time: 0.313240 Dec 16 15:52:00.137843 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 265/575] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:51:59 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1261 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:00.150195 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-4d13da49-8e8a-4d92-bea5-bbb082d30215 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:00.150884 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-4d13da49-8e8a-4d92-bea5-bbb082d30215 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:00.157171 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4d13da49-8e8a-4d92-bea5-bbb082d30215 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:00.157708 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4d13da49-8e8a-4d92-bea5-bbb082d30215 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:00.158557 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4d13da49-8e8a-4d92-bea5-bbb082d30215 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:00.159218 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4d13da49-8e8a-4d92-bea5-bbb082d30215 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:00.202214 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4d13da49-8e8a-4d92-bea5-bbb082d30215 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:00.202669 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4d13da49-8e8a-4d92-bea5-bbb082d30215 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:00.203098 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.objects.instance [None req-4d13da49-8e8a-4d92-bea5-bbb082d30215 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lazy-loading 'fault' on Instance uuid 05750574-60a7-44f6-8fd6-d2fd52b57e91 {{(pid=122398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:52:00.277144 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-4d13da49-8e8a-4d92-bea5-bbb082d30215 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b68c71f879411a8374c609a182d704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290d9f6dcb5f4f878cc58690825a1e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:00.284946 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-4d13da49-8e8a-4d92-bea5-bbb082d30215 tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 200 len: 1312 microversion: 2.1 time: 0.138233 Dec 16 15:52:00.285514 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 266/576] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:00 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 1312 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:00.290205 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-eecf39d6-5d18-4fb3-9da9-bb7cd15175bc req-009ec055-3193-4656-a139-af752a1405e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05750574-60a7-44f6-8fd6-d2fd52b57e91", "name": "network-vif-deleted", "tag": "a162fcff-3fe8-4fc6-a489-b53c84cb0c45"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:00.291687 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:52:00.291687 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:52:00.298330 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-eecf39d6-5d18-4fb3-9da9-bb7cd15175bc req-009ec055-3193-4656-a139-af752a1405e1 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:00.298770 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-eecf39d6-5d18-4fb3-9da9-bb7cd15175bc req-009ec055-3193-4656-a139-af752a1405e1 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:00.309390 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-eecf39d6-5d18-4fb3-9da9-bb7cd15175bc req-009ec055-3193-4656-a139-af752a1405e1 service nova] Creating event network-vif-deleted:a162fcff-3fe8-4fc6-a489-b53c84cb0c45 for instance 05750574-60a7-44f6-8fd6-d2fd52b57e91 on hv-cinder-78447 Dec 16 15:52:00.314288 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-eecf39d6-5d18-4fb3-9da9-bb7cd15175bc req-009ec055-3193-4656-a139-af752a1405e1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027352 Dec 16 15:52:00.314834 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 267/577] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:52:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:52:00.422982 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-c88c1a25-d0f7-40b7-bea4-c7aaa0ea59db tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Flavor limits 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 15:52:00.423446 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-c88c1a25-d0f7-40b7-bea4-c7aaa0ea59db tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Image limits 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 15:52:00.423959 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-c88c1a25-d0f7-40b7-bea4-c7aaa0ea59db tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Flavor pref 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 15:52:00.424363 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-c88c1a25-d0f7-40b7-bea4-c7aaa0ea59db tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Image pref 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 15:52:00.424762 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-c88c1a25-d0f7-40b7-bea4-c7aaa0ea59db tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 15:52:00.433694 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c88c1a25-d0f7-40b7-bea4-c7aaa0ea59db tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:00.434136 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c88c1a25-d0f7-40b7-bea4-c7aaa0ea59db tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:00.434930 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c88c1a25-d0f7-40b7-bea4-c7aaa0ea59db tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:00.435353 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c88c1a25-d0f7-40b7-bea4-c7aaa0ea59db tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:00.451438 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-c88c1a25-d0f7-40b7-bea4-c7aaa0ea59db tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Getting quotas for project 5afea3407ef84fafa658a82512fb4d24. Resources: {'instances', 'ram', 'cores'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:52:00.455354 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-c88c1a25-d0f7-40b7-bea4-c7aaa0ea59db tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Getting quotas for user 92fd364ddd594b9eb5fe5ffad72ac32e and project 5afea3407ef84fafa658a82512fb4d24. Resources: {'instances', 'ram', 'cores'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:52:00.512112 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-c88c1a25-d0f7-40b7-bea4-c7aaa0ea59db tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Going to run 1 instances... {{(pid=122399) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 15:52:00.514341 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-c88c1a25-d0f7-40b7-bea4-c7aaa0ea59db tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: d87f6b70-6ea0-48c1-b18c-59052e3ff9d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0cc0d22d-8207-477e-9b77-bb3e8363f503',volume_size=None,volume_type=None)] {{(pid=122399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 15:52:00.651321 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-c88c1a25-d0f7-40b7-bea4-c7aaa0ea59db tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.011526 Dec 16 15:52:00.651888 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 311/578] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Dec 16 15:51:59 2021] POST /compute/v2.1/servers => generated 405 bytes in 1013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 15:52:00.662127 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-0137c086-36e6-4012-b2eb-cd788f538efc tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:00.662825 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-0137c086-36e6-4012-b2eb-cd788f538efc tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: d87f6b70-6ea0-48c1-b18c-59052e3ff9d3] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:00.718869 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-0137c086-36e6-4012-b2eb-cd788f538efc tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:00.725677 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-0137c086-36e6-4012-b2eb-cd788f538efc tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3" status: 200 len: 1094 microversion: 2.1 time: 0.067556 Dec 16 15:52:00.726233 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 268/579] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:00 2021] GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:01.155722 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-3c7d7bff-d3e1-4f0e-85e4-fe6b8522c37e tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:01.156435 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-3c7d7bff-d3e1-4f0e-85e4-fe6b8522c37e tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:01.163494 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3c7d7bff-d3e1-4f0e-85e4-fe6b8522c37e tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:01.163945 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3c7d7bff-d3e1-4f0e-85e4-fe6b8522c37e tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:01.164689 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3c7d7bff-d3e1-4f0e-85e4-fe6b8522c37e tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:01.165165 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3c7d7bff-d3e1-4f0e-85e4-fe6b8522c37e tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:01.300516 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-3c7d7bff-d3e1-4f0e-85e4-fe6b8522c37e tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:01.301653 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-8bf672a0-15b7-4f7c-96fc-c15c4cddce7a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:01.302261 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-8bf672a0-15b7-4f7c-96fc-c15c4cddce7a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] [instance: 05750574-60a7-44f6-8fd6-d2fd52b57e91] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:01.308522 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-3c7d7bff-d3e1-4f0e-85e4-fe6b8522c37e tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1261 microversion: 2.1 time: 0.157004 Dec 16 15:52:01.309129 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 312/580] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:01 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:52:01.319966 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8bf672a0-15b7-4f7c-96fc-c15c4cddce7a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:01.320489 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8bf672a0-15b7-4f7c-96fc-c15c4cddce7a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:01.321546 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8bf672a0-15b7-4f7c-96fc-c15c4cddce7a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:01.322081 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8bf672a0-15b7-4f7c-96fc-c15c4cddce7a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:01.336963 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.wsgi [None req-8bf672a0-15b7-4f7c-96fc-c15c4cddce7a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] HTTP exception thrown: Instance 05750574-60a7-44f6-8fd6-d2fd52b57e91 could not be found. Dec 16 15:52:01.337598 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-8bf672a0-15b7-4f7c-96fc-c15c4cddce7a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] Returning 404 to user: Instance 05750574-60a7-44f6-8fd6-d2fd52b57e91 could not be found. {{(pid=122398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:52:01.338426 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-8bf672a0-15b7-4f7c-96fc-c15c4cddce7a tempest-ServerRescueNegativeTestJSON-880100483 tempest-ServerRescueNegativeTestJSON-880100483-project] 10.222.0.31 "GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91" status: 404 len: 111 microversion: 2.1 time: 0.040650 Dec 16 15:52:01.338998 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 269/581] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:01 2021] GET /compute/v2.1/servers/05750574-60a7-44f6-8fd6-d2fd52b57e91 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:52:01.742426 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-41c7cffc-7637-4196-83c3-a392f4108809 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:01.743693 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-41c7cffc-7637-4196-83c3-a392f4108809 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: d87f6b70-6ea0-48c1-b18c-59052e3ff9d3] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:01.749666 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-41c7cffc-7637-4196-83c3-a392f4108809 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:01.750086 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-41c7cffc-7637-4196-83c3-a392f4108809 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:01.750991 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-41c7cffc-7637-4196-83c3-a392f4108809 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:01.751424 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-41c7cffc-7637-4196-83c3-a392f4108809 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:01.845936 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-41c7cffc-7637-4196-83c3-a392f4108809 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:01.856312 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-41c7cffc-7637-4196-83c3-a392f4108809 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3" status: 200 len: 1144 microversion: 2.1 time: 0.117535 Dec 16 15:52:01.856887 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 313/582] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:01 2021] GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 => generated 1144 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:02.325662 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-4793867f-b7ec-4589-9ce4-fae706c705a6 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:02.326440 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-4793867f-b7ec-4589-9ce4-fae706c705a6 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:02.334180 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4793867f-b7ec-4589-9ce4-fae706c705a6 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:02.334624 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4793867f-b7ec-4589-9ce4-fae706c705a6 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:02.335403 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4793867f-b7ec-4589-9ce4-fae706c705a6 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:02.335826 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4793867f-b7ec-4589-9ce4-fae706c705a6 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:02.581207 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-4793867f-b7ec-4589-9ce4-fae706c705a6 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:02.589042 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-4793867f-b7ec-4589-9ce4-fae706c705a6 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1261 microversion: 2.1 time: 0.268713 Dec 16 15:52:02.589611 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 270/583] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:02 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1261 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:02.874726 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-9e2eb1d9-c85c-4fc2-9505-a59855eeec28 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:02.875403 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-9e2eb1d9-c85c-4fc2-9505-a59855eeec28 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: d87f6b70-6ea0-48c1-b18c-59052e3ff9d3] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:02.881485 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9e2eb1d9-c85c-4fc2-9505-a59855eeec28 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:02.882001 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9e2eb1d9-c85c-4fc2-9505-a59855eeec28 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:02.882847 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9e2eb1d9-c85c-4fc2-9505-a59855eeec28 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:02.883330 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9e2eb1d9-c85c-4fc2-9505-a59855eeec28 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:02.973379 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-9e2eb1d9-c85c-4fc2-9505-a59855eeec28 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:02.981093 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-9e2eb1d9-c85c-4fc2-9505-a59855eeec28 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3" status: 200 len: 1144 microversion: 2.1 time: 0.110574 Dec 16 15:52:02.981695 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 314/584] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:02 2021] GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 => generated 1144 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:03.605559 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-cdc50dce-fbb8-4ffa-bbda-9b1bafba1f8d tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:03.606178 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-cdc50dce-fbb8-4ffa-bbda-9b1bafba1f8d tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:03.612404 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cdc50dce-fbb8-4ffa-bbda-9b1bafba1f8d tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:03.612911 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cdc50dce-fbb8-4ffa-bbda-9b1bafba1f8d tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:03.619518 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cdc50dce-fbb8-4ffa-bbda-9b1bafba1f8d tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:03.620004 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cdc50dce-fbb8-4ffa-bbda-9b1bafba1f8d tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:03.912551 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-cdc50dce-fbb8-4ffa-bbda-9b1bafba1f8d tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:03.922534 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-cdc50dce-fbb8-4ffa-bbda-9b1bafba1f8d tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1261 microversion: 2.1 time: 0.320547 Dec 16 15:52:03.926081 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 271/585] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:03 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1261 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:04.001385 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-bb4e6347-b136-4daf-8e4e-30e36fb3106d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:04.002833 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-bb4e6347-b136-4daf-8e4e-30e36fb3106d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: d87f6b70-6ea0-48c1-b18c-59052e3ff9d3] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:04.017718 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-bb4e6347-b136-4daf-8e4e-30e36fb3106d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:04.018599 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-bb4e6347-b136-4daf-8e4e-30e36fb3106d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:04.021129 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-bb4e6347-b136-4daf-8e4e-30e36fb3106d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:04.022302 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-bb4e6347-b136-4daf-8e4e-30e36fb3106d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:04.280892 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-bb4e6347-b136-4daf-8e4e-30e36fb3106d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:04.307333 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-bb4e6347-b136-4daf-8e4e-30e36fb3106d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3" status: 200 len: 1210 microversion: 2.1 time: 0.309298 Dec 16 15:52:04.309450 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 315/586] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:03 2021] GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 => generated 1210 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:04.942884 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-abbc2d96-5713-4ac7-837f-f6bee270b8a3 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:04.943804 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-abbc2d96-5713-4ac7-837f-f6bee270b8a3 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:04.957432 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-abbc2d96-5713-4ac7-837f-f6bee270b8a3 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:04.957885 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-abbc2d96-5713-4ac7-837f-f6bee270b8a3 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:04.958684 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-abbc2d96-5713-4ac7-837f-f6bee270b8a3 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:04.959127 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-abbc2d96-5713-4ac7-837f-f6bee270b8a3 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:05.324790 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-a0c3afc9-dcab-41b6-a19e-e85d02ab96e4 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:05.324790 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-a0c3afc9-dcab-41b6-a19e-e85d02ab96e4 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: d87f6b70-6ea0-48c1-b18c-59052e3ff9d3] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:05.334966 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a0c3afc9-dcab-41b6-a19e-e85d02ab96e4 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:05.340787 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a0c3afc9-dcab-41b6-a19e-e85d02ab96e4 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:05.343844 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a0c3afc9-dcab-41b6-a19e-e85d02ab96e4 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:05.345227 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a0c3afc9-dcab-41b6-a19e-e85d02ab96e4 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:05.566131 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-abbc2d96-5713-4ac7-837f-f6bee270b8a3 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:05.574326 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-abbc2d96-5713-4ac7-837f-f6bee270b8a3 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1261 microversion: 2.1 time: 0.635827 Dec 16 15:52:05.577732 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 272/587] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:04 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1261 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:05.765114 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-a0c3afc9-dcab-41b6-a19e-e85d02ab96e4 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:05.774559 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-a0c3afc9-dcab-41b6-a19e-e85d02ab96e4 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3" status: 200 len: 1265 microversion: 2.1 time: 0.454005 Dec 16 15:52:05.779179 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 316/588] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:05 2021] GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 => generated 1265 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:06.594735 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-78df35e6-95ec-41f3-aecd-d5120fca11b6 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:06.596083 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-78df35e6-95ec-41f3-aecd-d5120fca11b6 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:06.610535 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-78df35e6-95ec-41f3-aecd-d5120fca11b6 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:06.612913 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-78df35e6-95ec-41f3-aecd-d5120fca11b6 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:06.614026 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-78df35e6-95ec-41f3-aecd-d5120fca11b6 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:06.615969 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-78df35e6-95ec-41f3-aecd-d5120fca11b6 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:06.791777 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-023f4018-57fe-4417-91ab-7fcfc4900beb tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:06.792564 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-023f4018-57fe-4417-91ab-7fcfc4900beb tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: d87f6b70-6ea0-48c1-b18c-59052e3ff9d3] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:06.800189 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-023f4018-57fe-4417-91ab-7fcfc4900beb tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:06.800644 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-023f4018-57fe-4417-91ab-7fcfc4900beb tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:06.801504 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-023f4018-57fe-4417-91ab-7fcfc4900beb tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:06.801903 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-023f4018-57fe-4417-91ab-7fcfc4900beb tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:07.053596 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-78df35e6-95ec-41f3-aecd-d5120fca11b6 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:07.062500 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-78df35e6-95ec-41f3-aecd-d5120fca11b6 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1261 microversion: 2.1 time: 0.472051 Dec 16 15:52:07.066452 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 273/589] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:06 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1261 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:07.081374 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-cefd9319-b371-421b-bebf-d8a6549d3a41 req-e92de451-416f-4fbd-854e-3793207d06e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d87f6b70-6ea0-48c1-b18c-59052e3ff9d3", "tag": "41774a69-3e6e-4cb8-a2ce-3f35fab82c16"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:07.101845 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:52:07.101845 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:52:07.111269 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-cefd9319-b371-421b-bebf-d8a6549d3a41 req-e92de451-416f-4fbd-854e-3793207d06e5 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:07.111982 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-cefd9319-b371-421b-bebf-d8a6549d3a41 req-e92de451-416f-4fbd-854e-3793207d06e5 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:07.124823 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-cefd9319-b371-421b-bebf-d8a6549d3a41 req-e92de451-416f-4fbd-854e-3793207d06e5 service nova] Creating event network-changed:41774a69-3e6e-4cb8-a2ce-3f35fab82c16 for instance d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 on hv-cinder-78447 Dec 16 15:52:07.133032 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-cefd9319-b371-421b-bebf-d8a6549d3a41 req-e92de451-416f-4fbd-854e-3793207d06e5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064918 Dec 16 15:52:07.133735 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 274/590] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:52:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:52:07.274505 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-023f4018-57fe-4417-91ab-7fcfc4900beb tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:07.284901 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-023f4018-57fe-4417-91ab-7fcfc4900beb tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3" status: 200 len: 1265 microversion: 2.1 time: 0.496812 Dec 16 15:52:07.285511 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 317/591] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:06 2021] GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 => generated 1265 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:08.085873 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-73bdd8bb-536c-419b-b63b-34a2b3ce742c tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:08.087677 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-73bdd8bb-536c-419b-b63b-34a2b3ce742c tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:08.094592 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-73bdd8bb-536c-419b-b63b-34a2b3ce742c tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:08.095326 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-73bdd8bb-536c-419b-b63b-34a2b3ce742c tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:08.096315 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-73bdd8bb-536c-419b-b63b-34a2b3ce742c tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:08.097254 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-73bdd8bb-536c-419b-b63b-34a2b3ce742c tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:08.303598 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-76c08534-4891-4045-848b-c09481c2219f tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:08.304876 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-76c08534-4891-4045-848b-c09481c2219f tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: d87f6b70-6ea0-48c1-b18c-59052e3ff9d3] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:08.311682 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-76c08534-4891-4045-848b-c09481c2219f tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:08.312396 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-76c08534-4891-4045-848b-c09481c2219f tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:08.313345 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-76c08534-4891-4045-848b-c09481c2219f tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:08.313948 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-76c08534-4891-4045-848b-c09481c2219f tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:08.587995 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-73bdd8bb-536c-419b-b63b-34a2b3ce742c tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:08.601896 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-73bdd8bb-536c-419b-b63b-34a2b3ce742c tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1261 microversion: 2.1 time: 0.522666 Dec 16 15:52:08.605499 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 275/592] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:08 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1261 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:52:08.769551 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-76c08534-4891-4045-848b-c09481c2219f tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:08.777882 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-76c08534-4891-4045-848b-c09481c2219f tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3" status: 200 len: 1265 microversion: 2.1 time: 0.479531 Dec 16 15:52:08.785869 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 318/593] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:08 2021] GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 => generated 1265 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:09.620661 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-5f3c3d6c-ed14-4573-8091-2e2775fa8790 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:09.622512 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-5f3c3d6c-ed14-4573-8091-2e2775fa8790 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:09.631269 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5f3c3d6c-ed14-4573-8091-2e2775fa8790 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:09.633307 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5f3c3d6c-ed14-4573-8091-2e2775fa8790 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:09.635505 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5f3c3d6c-ed14-4573-8091-2e2775fa8790 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:09.636121 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5f3c3d6c-ed14-4573-8091-2e2775fa8790 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:09.774158 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-87944f37-b132-4036-9b63-61df06896b69 req-5f0a073b-9a12-4a06-a255-6a51a49c1ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "248b8eac-f030-4761-a6c9-0ddaf6475f0f", "name": "network-vif-plugged", "status": "completed", "tag": "8e2fdbb4-3edf-41eb-8daa-904ea54bacb1"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:09.776133 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:52:09.776133 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:52:09.793737 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-87944f37-b132-4036-9b63-61df06896b69 req-5f0a073b-9a12-4a06-a255-6a51a49c1ed6 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:09.794185 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-87944f37-b132-4036-9b63-61df06896b69 req-5f0a073b-9a12-4a06-a255-6a51a49c1ed6 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:09.842127 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-87944f37-b132-4036-9b63-61df06896b69 req-5f0a073b-9a12-4a06-a255-6a51a49c1ed6 service nova] Creating event network-vif-plugged:8e2fdbb4-3edf-41eb-8daa-904ea54bacb1 for instance 248b8eac-f030-4761-a6c9-0ddaf6475f0f on hv-cinder-78447 Dec 16 15:52:09.850559 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-87944f37-b132-4036-9b63-61df06896b69 req-5f0a073b-9a12-4a06-a255-6a51a49c1ed6 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080074 Dec 16 15:52:09.854654 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 319/594] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:52:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:52:09.877591 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ae23005a-8ed1-4e07-bc5a-bc5d6e9f493e tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:09.878467 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-ae23005a-8ed1-4e07-bc5a-bc5d6e9f493e tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: d87f6b70-6ea0-48c1-b18c-59052e3ff9d3] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:09.897206 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ae23005a-8ed1-4e07-bc5a-bc5d6e9f493e tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:09.897689 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ae23005a-8ed1-4e07-bc5a-bc5d6e9f493e tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:09.898484 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ae23005a-8ed1-4e07-bc5a-bc5d6e9f493e tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:09.898914 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ae23005a-8ed1-4e07-bc5a-bc5d6e9f493e tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:09.899907 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-5f3c3d6c-ed14-4573-8091-2e2775fa8790 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:09.910443 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-5f3c3d6c-ed14-4573-8091-2e2775fa8790 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1261 microversion: 2.1 time: 0.293268 Dec 16 15:52:09.915801 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 276/595] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:09 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1261 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:10.215062 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-ae23005a-8ed1-4e07-bc5a-bc5d6e9f493e tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:10.222783 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-ae23005a-8ed1-4e07-bc5a-bc5d6e9f493e tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3" status: 200 len: 1265 microversion: 2.1 time: 0.366884 Dec 16 15:52:10.225476 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 320/596] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:09 2021] GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 => generated 1265 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:10.927794 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-7092c14a-a086-4d1c-98a1-813538f11131 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:10.929206 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-7092c14a-a086-4d1c-98a1-813538f11131 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:10.949388 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7092c14a-a086-4d1c-98a1-813538f11131 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:10.949892 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7092c14a-a086-4d1c-98a1-813538f11131 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:10.950863 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7092c14a-a086-4d1c-98a1-813538f11131 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:10.951455 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7092c14a-a086-4d1c-98a1-813538f11131 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:11.187921 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-7092c14a-a086-4d1c-98a1-813538f11131 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:11.197069 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-7092c14a-a086-4d1c-98a1-813538f11131 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1261 microversion: 2.1 time: 0.273457 Dec 16 15:52:11.206473 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 277/597] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:10 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1261 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:11.242449 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-c41afb37-6c69-4ed1-9cc5-e4493d2ef356 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:11.243053 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-c41afb37-6c69-4ed1-9cc5-e4493d2ef356 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: d87f6b70-6ea0-48c1-b18c-59052e3ff9d3] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:11.254158 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c41afb37-6c69-4ed1-9cc5-e4493d2ef356 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:11.254639 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c41afb37-6c69-4ed1-9cc5-e4493d2ef356 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:11.255437 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c41afb37-6c69-4ed1-9cc5-e4493d2ef356 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:11.255902 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c41afb37-6c69-4ed1-9cc5-e4493d2ef356 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:11.311414 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:52:11.311603 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: Thu Dec 16 15:52:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 15:52:11.440395 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-c41afb37-6c69-4ed1-9cc5-e4493d2ef356 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:11.450525 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-c41afb37-6c69-4ed1-9cc5-e4493d2ef356 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3" status: 200 len: 1265 microversion: 2.1 time: 0.211659 Dec 16 15:52:11.451458 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 321/598] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:11 2021] GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:12.214306 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-eab0c456-f8bf-44b0-b71b-77a2f56fbdd8 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:12.216252 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-eab0c456-f8bf-44b0-b71b-77a2f56fbdd8 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:12.227121 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-eab0c456-f8bf-44b0-b71b-77a2f56fbdd8 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:12.234674 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-eab0c456-f8bf-44b0-b71b-77a2f56fbdd8 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:12.235800 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-eab0c456-f8bf-44b0-b71b-77a2f56fbdd8 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:12.236383 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-eab0c456-f8bf-44b0-b71b-77a2f56fbdd8 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:12.468679 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-13f875d2-5c81-4447-b459-ecfbf961d4ca tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:12.470500 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-13f875d2-5c81-4447-b459-ecfbf961d4ca tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: d87f6b70-6ea0-48c1-b18c-59052e3ff9d3] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:12.483390 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-13f875d2-5c81-4447-b459-ecfbf961d4ca tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:12.488246 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-13f875d2-5c81-4447-b459-ecfbf961d4ca tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:12.489286 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-13f875d2-5c81-4447-b459-ecfbf961d4ca tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:12.489978 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-13f875d2-5c81-4447-b459-ecfbf961d4ca tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:12.659680 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-eab0c456-f8bf-44b0-b71b-77a2f56fbdd8 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:12.669783 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-eab0c456-f8bf-44b0-b71b-77a2f56fbdd8 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1444 microversion: 2.1 time: 0.458400 Dec 16 15:52:12.670697 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 278/599] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:12 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1444 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:12.686898 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-df62fd2d-b80b-49b4-a45d-6ce176cf8015 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:12.688028 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-df62fd2d-b80b-49b4-a45d-6ce176cf8015 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:12.695758 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-df62fd2d-b80b-49b4-a45d-6ce176cf8015 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:12.696588 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-df62fd2d-b80b-49b4-a45d-6ce176cf8015 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:12.697828 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-df62fd2d-b80b-49b4-a45d-6ce176cf8015 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:12.698498 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-df62fd2d-b80b-49b4-a45d-6ce176cf8015 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:12.936900 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-13f875d2-5c81-4447-b459-ecfbf961d4ca tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:12.971241 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-13f875d2-5c81-4447-b459-ecfbf961d4ca tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3" status: 200 len: 1265 microversion: 2.1 time: 0.507405 Dec 16 15:52:12.975795 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 322/600] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:12 2021] GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 => generated 1265 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:13.056765 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-df62fd2d-b80b-49b4-a45d-6ce176cf8015 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:13.067576 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-df62fd2d-b80b-49b4-a45d-6ce176cf8015 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1444 microversion: 2.1 time: 0.382259 Dec 16 15:52:13.068432 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 279/601] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:12 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1444 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:13.991503 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-82564071-139f-47d1-90c1-c81419865923 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:13.992895 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-82564071-139f-47d1-90c1-c81419865923 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: d87f6b70-6ea0-48c1-b18c-59052e3ff9d3] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:14.003949 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-82564071-139f-47d1-90c1-c81419865923 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:14.007559 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-82564071-139f-47d1-90c1-c81419865923 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:14.008518 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-82564071-139f-47d1-90c1-c81419865923 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:14.009578 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-82564071-139f-47d1-90c1-c81419865923 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:14.563537 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-82564071-139f-47d1-90c1-c81419865923 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:14.573200 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-82564071-139f-47d1-90c1-c81419865923 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3" status: 200 len: 1265 microversion: 2.1 time: 0.585515 Dec 16 15:52:14.585789 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 323/602] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:13 2021] GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 => generated 1265 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:15.592945 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-5ae477e9-a3a9-42b8-8e76-fc36569fcb21 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:15.596005 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-51e36aca-4057-4d2a-a33b-72e45fa60ea6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'create', calling method: .version_select at 0x7fed5defa670>, body: {"keypair": {"name": "tempest-keypair-1889749874"}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:15.598030 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-5ae477e9-a3a9-42b8-8e76-fc36569fcb21 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: d87f6b70-6ea0-48c1-b18c-59052e3ff9d3] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:15.614184 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5ae477e9-a3a9-42b8-8e76-fc36569fcb21 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:15.615009 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5ae477e9-a3a9-42b8-8e76-fc36569fcb21 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:15.616429 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5ae477e9-a3a9-42b8-8e76-fc36569fcb21 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:15.617082 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5ae477e9-a3a9-42b8-8e76-fc36569fcb21 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:15.639953 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.quota [None req-51e36aca-4057-4d2a-a33b-72e45fa60ea6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Getting quotas for project 66fbf45043974460803db71f1750aacc. Resources: {'key_pairs'} {{(pid=122398) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:52:15.656237 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.quota [None req-51e36aca-4057-4d2a-a33b-72e45fa60ea6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Getting quotas for user 5cef547b44664cf48870933998504758 and project 66fbf45043974460803db71f1750aacc. Resources: {'key_pairs'} {{(pid=122398) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:52:15.937338 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-5ae477e9-a3a9-42b8-8e76-fc36569fcb21 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:15.945181 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-5ae477e9-a3a9-42b8-8e76-fc36569fcb21 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3" status: 200 len: 1265 microversion: 2.1 time: 0.359132 Dec 16 15:52:15.949213 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 324/603] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:15 2021] GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 => generated 1265 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:16.011552 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.quota [None req-51e36aca-4057-4d2a-a33b-72e45fa60ea6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Getting quotas for project 66fbf45043974460803db71f1750aacc. Resources: {'key_pairs'} {{(pid=122398) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:52:16.015602 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.quota [None req-51e36aca-4057-4d2a-a33b-72e45fa60ea6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Getting quotas for user 5cef547b44664cf48870933998504758 and project 66fbf45043974460803db71f1750aacc. Resources: {'key_pairs'} {{(pid=122398) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:52:16.033869 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-51e36aca-4057-4d2a-a33b-72e45fa60ea6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.872501 Dec 16 15:52:16.042481 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 280/604] 10.222.0.31 () {62 vars in 1198 bytes} [Thu Dec 16 15:52:15 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 882 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 16 15:52:16.969506 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-00f036a6-ddf8-4f3f-9ad9-35cac2346ac9 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:16.971937 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-00f036a6-ddf8-4f3f-9ad9-35cac2346ac9 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: d87f6b70-6ea0-48c1-b18c-59052e3ff9d3] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:16.987501 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-00f036a6-ddf8-4f3f-9ad9-35cac2346ac9 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:16.987932 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-00f036a6-ddf8-4f3f-9ad9-35cac2346ac9 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:16.992454 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-00f036a6-ddf8-4f3f-9ad9-35cac2346ac9 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:16.994455 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-00f036a6-ddf8-4f3f-9ad9-35cac2346ac9 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:17.180343 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-a2adc2d2-cafa-4844-91c6-13903b4e26eb req-f72d4d1c-3e31-4f03-a6c9-818d6ef58da0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "248b8eac-f030-4761-a6c9-0ddaf6475f0f", "tag": "8e2fdbb4-3edf-41eb-8daa-904ea54bacb1"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:17.183335 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:52:17.183335 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:52:17.203609 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-a2adc2d2-cafa-4844-91c6-13903b4e26eb req-f72d4d1c-3e31-4f03-a6c9-818d6ef58da0 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:17.204752 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-a2adc2d2-cafa-4844-91c6-13903b4e26eb req-f72d4d1c-3e31-4f03-a6c9-818d6ef58da0 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:17.239313 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-a2adc2d2-cafa-4844-91c6-13903b4e26eb req-f72d4d1c-3e31-4f03-a6c9-818d6ef58da0 service nova] Creating event network-changed:8e2fdbb4-3edf-41eb-8daa-904ea54bacb1 for instance 248b8eac-f030-4761-a6c9-0ddaf6475f0f on hv-cinder-78447 Dec 16 15:52:17.249015 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-a2adc2d2-cafa-4844-91c6-13903b4e26eb req-f72d4d1c-3e31-4f03-a6c9-818d6ef58da0 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072080 Dec 16 15:52:17.253658 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 281/605] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:52:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:52:17.269135 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-00f036a6-ddf8-4f3f-9ad9-35cac2346ac9 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:17.296469 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-00f036a6-ddf8-4f3f-9ad9-35cac2346ac9 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3" status: 200 len: 1265 microversion: 2.1 time: 0.334116 Dec 16 15:52:17.300675 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 325/606] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:16 2021] GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 => generated 1265 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:18.317189 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-1fc2cc3e-26c1-4493-877b-a00a2b576b42 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:18.318559 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-1fc2cc3e-26c1-4493-877b-a00a2b576b42 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: d87f6b70-6ea0-48c1-b18c-59052e3ff9d3] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:18.333358 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1fc2cc3e-26c1-4493-877b-a00a2b576b42 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:18.336070 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1fc2cc3e-26c1-4493-877b-a00a2b576b42 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:18.337103 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1fc2cc3e-26c1-4493-877b-a00a2b576b42 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:18.338837 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1fc2cc3e-26c1-4493-877b-a00a2b576b42 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:19.164791 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-1fc2cc3e-26c1-4493-877b-a00a2b576b42 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:19.170806 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-0d974b05-6a27-4050-aec2-2439de8ea785 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-147111187", "imageRef": "2a1434ad-0c2c-4725-baad-a605624baf01", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d7f36349-73c7-464a-bf62-5f09a6e738d6"}], "security_groups": [{"name": "tempest-securitygroup--1075726383"}], "key_name": "tempest-keypair-1889749874", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:19.182152 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-1fc2cc3e-26c1-4493-877b-a00a2b576b42 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3" status: 200 len: 1265 microversion: 2.1 time: 0.869358 Dec 16 15:52:19.192445 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 282/607] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:18 2021] GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 => generated 1265 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:19.375891 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.network.neutron [None req-0d974b05-6a27-4050-aec2-2439de8ea785 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] validate_networks() for [('d7f36349-73c7-464a-bf62-5f09a6e738d6', None, None, None, None, None)] {{(pid=122399) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 15:52:20.207887 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-eab3935a-9c97-4701-9a1c-c3088e21f32f tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:20.208491 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-eab3935a-9c97-4701-9a1c-c3088e21f32f tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: d87f6b70-6ea0-48c1-b18c-59052e3ff9d3] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:20.216347 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-eab3935a-9c97-4701-9a1c-c3088e21f32f tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:20.227065 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-eab3935a-9c97-4701-9a1c-c3088e21f32f tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:20.228087 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-eab3935a-9c97-4701-9a1c-c3088e21f32f tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:20.229158 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-eab3935a-9c97-4701-9a1c-c3088e21f32f tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:20.236321 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-0d974b05-6a27-4050-aec2-2439de8ea785 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Flavor limits 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 15:52:20.236986 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-0d974b05-6a27-4050-aec2-2439de8ea785 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Image limits 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 15:52:20.237336 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-0d974b05-6a27-4050-aec2-2439de8ea785 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Flavor pref 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 15:52:20.238987 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-0d974b05-6a27-4050-aec2-2439de8ea785 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Image pref 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 15:52:20.239610 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-0d974b05-6a27-4050-aec2-2439de8ea785 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 15:52:20.271341 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0d974b05-6a27-4050-aec2-2439de8ea785 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:20.271760 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0d974b05-6a27-4050-aec2-2439de8ea785 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:20.274621 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0d974b05-6a27-4050-aec2-2439de8ea785 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:20.275061 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0d974b05-6a27-4050-aec2-2439de8ea785 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:20.329912 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-0d974b05-6a27-4050-aec2-2439de8ea785 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Getting quotas for project 66fbf45043974460803db71f1750aacc. Resources: {'instances', 'ram', 'cores'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:52:20.340337 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-0d974b05-6a27-4050-aec2-2439de8ea785 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Getting quotas for user 5cef547b44664cf48870933998504758 and project 66fbf45043974460803db71f1750aacc. Resources: {'instances', 'ram', 'cores'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:52:20.353948 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-0d974b05-6a27-4050-aec2-2439de8ea785 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Going to run 1 instances... {{(pid=122399) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 15:52:20.357631 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-0d974b05-6a27-4050-aec2-2439de8ea785 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a1434ad-0c2c-4725-baad-a605624baf01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 15:52:20.445709 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-0d974b05-6a27-4050-aec2-2439de8ea785 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.285830 Dec 16 15:52:20.447557 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 326/608] 10.222.0.31 () {62 vars in 1187 bytes} [Thu Dec 16 15:52:19 2021] POST /compute/v2.1/servers => generated 402 bytes in 1289 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Dec 16 15:52:20.463247 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-fa34531b-b363-4231-b41a-2095b035358e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:20.466245 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-fa34531b-b363-4231-b41a-2095b035358e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:20.504168 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-eab3935a-9c97-4701-9a1c-c3088e21f32f tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:20.511960 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-eab3935a-9c97-4701-9a1c-c3088e21f32f tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3" status: 200 len: 1265 microversion: 2.1 time: 0.307731 Dec 16 15:52:20.527564 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 283/609] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:20 2021] GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 => generated 1265 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:20.554441 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-fa34531b-b363-4231-b41a-2095b035358e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:20.562510 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-fa34531b-b363-4231-b41a-2095b035358e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:20.565426 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-fa34531b-b363-4231-b41a-2095b035358e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:20.567018 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-fa34531b-b363-4231-b41a-2095b035358e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1281 microversion: 2.20 time: 0.112244 Dec 16 15:52:20.568125 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 327/610] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:52:20 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1281 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:52:21.543438 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-7522457f-7909-48f8-bafc-9d3040eaa8e1 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:21.544885 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-7522457f-7909-48f8-bafc-9d3040eaa8e1 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: d87f6b70-6ea0-48c1-b18c-59052e3ff9d3] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:21.558447 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7522457f-7909-48f8-bafc-9d3040eaa8e1 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:21.558904 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7522457f-7909-48f8-bafc-9d3040eaa8e1 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:21.559702 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7522457f-7909-48f8-bafc-9d3040eaa8e1 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:21.560141 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7522457f-7909-48f8-bafc-9d3040eaa8e1 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:21.585888 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-51f09af2-d942-4bb8-9bf0-1c940b837599 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:21.586560 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-51f09af2-d942-4bb8-9bf0-1c940b837599 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:21.611450 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-51f09af2-d942-4bb8-9bf0-1c940b837599 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:21.613646 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-51f09af2-d942-4bb8-9bf0-1c940b837599 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:21.616100 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-51f09af2-d942-4bb8-9bf0-1c940b837599 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:21.616722 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-51f09af2-d942-4bb8-9bf0-1c940b837599 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:21.822169 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-51f09af2-d942-4bb8-9bf0-1c940b837599 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:21.834265 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-51f09af2-d942-4bb8-9bf0-1c940b837599 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:21.845161 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-51f09af2-d942-4bb8-9bf0-1c940b837599 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:21.848157 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-51f09af2-d942-4bb8-9bf0-1c940b837599 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1333 microversion: 2.20 time: 0.266272 Dec 16 15:52:21.854310 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 328/611] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:52:21 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1333 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:52:21.875581 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-7a18b4d2-6055-4ba0-b603-e8bd89ad8511 req-34a23b4d-f968-4f30-9652-c781976338bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d87f6b70-6ea0-48c1-b18c-59052e3ff9d3", "name": "network-vif-plugged", "status": "completed", "tag": "41774a69-3e6e-4cb8-a2ce-3f35fab82c16"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:21.877329 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:52:21.877329 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:52:21.886152 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-7522457f-7909-48f8-bafc-9d3040eaa8e1 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:21.895953 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-7522457f-7909-48f8-bafc-9d3040eaa8e1 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3" status: 200 len: 1265 microversion: 2.1 time: 0.356391 Dec 16 15:52:21.911010 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 284/612] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:21 2021] GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 => generated 1265 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:21.915937 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-7a18b4d2-6055-4ba0-b603-e8bd89ad8511 req-34a23b4d-f968-4f30-9652-c781976338bc service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:21.916570 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-7a18b4d2-6055-4ba0-b603-e8bd89ad8511 req-34a23b4d-f968-4f30-9652-c781976338bc service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:21.929290 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-7a18b4d2-6055-4ba0-b603-e8bd89ad8511 req-34a23b4d-f968-4f30-9652-c781976338bc service nova] Creating event network-vif-plugged:41774a69-3e6e-4cb8-a2ce-3f35fab82c16 for instance d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 on hv-cinder-78447 Dec 16 15:52:21.935313 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-7a18b4d2-6055-4ba0-b603-e8bd89ad8511 req-34a23b4d-f968-4f30-9652-c781976338bc service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077945 Dec 16 15:52:21.946197 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 329/613] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:52:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:52:22.876347 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-87018fc3-029d-410b-ba99-d570ef44372c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:22.877108 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-87018fc3-029d-410b-ba99-d570ef44372c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:22.902280 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-87018fc3-029d-410b-ba99-d570ef44372c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:22.903092 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-87018fc3-029d-410b-ba99-d570ef44372c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:22.904233 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-87018fc3-029d-410b-ba99-d570ef44372c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:22.904901 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-87018fc3-029d-410b-ba99-d570ef44372c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:22.922266 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-46d16a40-b1d5-4673-a900-b0aad4a7bed0 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:22.925850 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-46d16a40-b1d5-4673-a900-b0aad4a7bed0 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: d87f6b70-6ea0-48c1-b18c-59052e3ff9d3] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:22.940782 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-46d16a40-b1d5-4673-a900-b0aad4a7bed0 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:22.944231 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-46d16a40-b1d5-4673-a900-b0aad4a7bed0 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:22.946352 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-46d16a40-b1d5-4673-a900-b0aad4a7bed0 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:22.948930 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-46d16a40-b1d5-4673-a900-b0aad4a7bed0 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:23.001126 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-87018fc3-029d-410b-ba99-d570ef44372c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:23.017198 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-87018fc3-029d-410b-ba99-d570ef44372c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:23.020728 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-87018fc3-029d-410b-ba99-d570ef44372c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:23.022910 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-87018fc3-029d-410b-ba99-d570ef44372c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1339 microversion: 2.20 time: 0.153944 Dec 16 15:52:23.023954 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 285/614] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:52:22 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1339 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:52:23.311828 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-46d16a40-b1d5-4673-a900-b0aad4a7bed0 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:23.324693 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-46d16a40-b1d5-4673-a900-b0aad4a7bed0 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3" status: 200 len: 1265 microversion: 2.1 time: 0.409811 Dec 16 15:52:23.325712 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 330/615] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:22 2021] GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 => generated 1265 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:24.042578 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-3327e4ab-2435-49b9-9c40-10f3fb9b94b5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:24.043267 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-3327e4ab-2435-49b9-9c40-10f3fb9b94b5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:24.051261 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3327e4ab-2435-49b9-9c40-10f3fb9b94b5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:24.052067 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3327e4ab-2435-49b9-9c40-10f3fb9b94b5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:24.053132 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3327e4ab-2435-49b9-9c40-10f3fb9b94b5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:24.053798 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3327e4ab-2435-49b9-9c40-10f3fb9b94b5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:24.201383 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-22c293f5-8d68-40de-8263-c729d68e9b9e req-c98227f8-d49e-49c9-a9bd-3a6e00f3673b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "635ee3bb-dc82-4d25-95fc-ef55d01f0705", "tag": "d48abd91-ed3c-4f04-8767-5e6f0211d6fe"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:24.205563 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:52:24.205563 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:52:24.231383 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-22c293f5-8d68-40de-8263-c729d68e9b9e req-c98227f8-d49e-49c9-a9bd-3a6e00f3673b service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:24.234684 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-22c293f5-8d68-40de-8263-c729d68e9b9e req-c98227f8-d49e-49c9-a9bd-3a6e00f3673b service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:24.264198 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-22c293f5-8d68-40de-8263-c729d68e9b9e req-c98227f8-d49e-49c9-a9bd-3a6e00f3673b service nova] Creating event network-changed:d48abd91-ed3c-4f04-8767-5e6f0211d6fe for instance 635ee3bb-dc82-4d25-95fc-ef55d01f0705 on hv-cinder-78447 Dec 16 15:52:24.281493 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-22c293f5-8d68-40de-8263-c729d68e9b9e req-c98227f8-d49e-49c9-a9bd-3a6e00f3673b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084310 Dec 16 15:52:24.282871 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 331/616] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:52:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:52:24.344761 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-76264a3b-6e22-4ce2-8b6b-0bbcb19a388c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:24.345522 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-76264a3b-6e22-4ce2-8b6b-0bbcb19a388c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: d87f6b70-6ea0-48c1-b18c-59052e3ff9d3] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:24.370907 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-76264a3b-6e22-4ce2-8b6b-0bbcb19a388c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:24.372887 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-76264a3b-6e22-4ce2-8b6b-0bbcb19a388c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:24.373783 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-76264a3b-6e22-4ce2-8b6b-0bbcb19a388c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:24.374225 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-76264a3b-6e22-4ce2-8b6b-0bbcb19a388c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:24.429166 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-3327e4ab-2435-49b9-9c40-10f3fb9b94b5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:24.440662 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-3327e4ab-2435-49b9-9c40-10f3fb9b94b5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:24.442273 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-3327e4ab-2435-49b9-9c40-10f3fb9b94b5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:24.443661 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-3327e4ab-2435-49b9-9c40-10f3fb9b94b5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1407 microversion: 2.20 time: 0.405955 Dec 16 15:52:24.444733 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 286/617] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:52:24 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:52:24.649951 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-76264a3b-6e22-4ce2-8b6b-0bbcb19a388c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:24.660410 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-76264a3b-6e22-4ce2-8b6b-0bbcb19a388c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3" status: 200 len: 1450 microversion: 2.1 time: 0.321153 Dec 16 15:52:24.662349 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 332/618] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:24 2021] GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 => generated 1450 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:24.683166 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-a67ca2e7-4478-4891-b3f4-7b2e24978447 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:24.683877 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-a67ca2e7-4478-4891-b3f4-7b2e24978447 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: d87f6b70-6ea0-48c1-b18c-59052e3ff9d3] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:24.696496 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a67ca2e7-4478-4891-b3f4-7b2e24978447 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:24.697241 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a67ca2e7-4478-4891-b3f4-7b2e24978447 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:24.698270 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a67ca2e7-4478-4891-b3f4-7b2e24978447 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:24.699865 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a67ca2e7-4478-4891-b3f4-7b2e24978447 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:24.995766 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-a67ca2e7-4478-4891-b3f4-7b2e24978447 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:25.016476 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-a67ca2e7-4478-4891-b3f4-7b2e24978447 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3" status: 200 len: 1450 microversion: 2.1 time: 0.338784 Dec 16 15:52:25.028652 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 287/619] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:24 2021] GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 => generated 1450 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:25.493187 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-028f5f52-9821-4605-bf7a-fe8112f522a7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:25.512664 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-028f5f52-9821-4605-bf7a-fe8112f522a7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:25.530560 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-028f5f52-9821-4605-bf7a-fe8112f522a7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:25.531653 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-028f5f52-9821-4605-bf7a-fe8112f522a7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:25.532524 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-028f5f52-9821-4605-bf7a-fe8112f522a7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:25.533149 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-028f5f52-9821-4605-bf7a-fe8112f522a7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:25.888116 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-028f5f52-9821-4605-bf7a-fe8112f522a7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:25.904499 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-028f5f52-9821-4605-bf7a-fe8112f522a7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:25.908779 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-028f5f52-9821-4605-bf7a-fe8112f522a7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:25.915082 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-028f5f52-9821-4605-bf7a-fe8112f522a7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1407 microversion: 2.20 time: 0.448189 Dec 16 15:52:25.918573 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 333/620] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:52:25 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1407 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:52:26.944193 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-6f7f1139-1de7-41b1-81e8-cc81df9a064e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:26.945826 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-6f7f1139-1de7-41b1-81e8-cc81df9a064e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:26.953348 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6f7f1139-1de7-41b1-81e8-cc81df9a064e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:26.953817 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6f7f1139-1de7-41b1-81e8-cc81df9a064e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:26.954814 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6f7f1139-1de7-41b1-81e8-cc81df9a064e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:26.955294 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6f7f1139-1de7-41b1-81e8-cc81df9a064e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:27.103813 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-6f7f1139-1de7-41b1-81e8-cc81df9a064e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:27.121679 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-6f7f1139-1de7-41b1-81e8-cc81df9a064e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:27.123368 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-6f7f1139-1de7-41b1-81e8-cc81df9a064e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:27.124677 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-6f7f1139-1de7-41b1-81e8-cc81df9a064e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1407 microversion: 2.20 time: 0.189921 Dec 16 15:52:27.125974 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 288/621] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:52:26 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:52:27.822238 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-e9c47c70-9ee2-44c9-86fc-794f968133f2 req-b611c71b-5a15-4405-b4f1-8e88abed0ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d87f6b70-6ea0-48c1-b18c-59052e3ff9d3", "tag": "41774a69-3e6e-4cb8-a2ce-3f35fab82c16"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:27.823875 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:52:27.823875 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:52:27.834010 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-e9c47c70-9ee2-44c9-86fc-794f968133f2 req-b611c71b-5a15-4405-b4f1-8e88abed0ad1 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:27.834455 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-e9c47c70-9ee2-44c9-86fc-794f968133f2 req-b611c71b-5a15-4405-b4f1-8e88abed0ad1 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:27.847084 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-e9c47c70-9ee2-44c9-86fc-794f968133f2 req-b611c71b-5a15-4405-b4f1-8e88abed0ad1 service nova] Creating event network-changed:41774a69-3e6e-4cb8-a2ce-3f35fab82c16 for instance d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 on hv-cinder-78447 Dec 16 15:52:27.853944 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-e9c47c70-9ee2-44c9-86fc-794f968133f2 req-b611c71b-5a15-4405-b4f1-8e88abed0ad1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035315 Dec 16 15:52:27.855161 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 334/622] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:52:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:52:28.143421 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-9d82af59-de23-49f0-88e7-968363cb8fe6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:28.144593 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-9d82af59-de23-49f0-88e7-968363cb8fe6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:28.155336 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9d82af59-de23-49f0-88e7-968363cb8fe6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:28.159954 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9d82af59-de23-49f0-88e7-968363cb8fe6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:28.160896 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9d82af59-de23-49f0-88e7-968363cb8fe6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:28.161649 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9d82af59-de23-49f0-88e7-968363cb8fe6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:28.458264 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-9d82af59-de23-49f0-88e7-968363cb8fe6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:28.477253 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-9d82af59-de23-49f0-88e7-968363cb8fe6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:28.488114 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-9d82af59-de23-49f0-88e7-968363cb8fe6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:28.503729 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-9d82af59-de23-49f0-88e7-968363cb8fe6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1407 microversion: 2.20 time: 0.364262 Dec 16 15:52:28.504788 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 289/623] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:52:28 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1407 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:52:29.523172 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-1e7dce16-1d4a-4b30-8d43-fd014e4c0a14 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:29.525518 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-1e7dce16-1d4a-4b30-8d43-fd014e4c0a14 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:29.533617 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1e7dce16-1d4a-4b30-8d43-fd014e4c0a14 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:29.534972 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1e7dce16-1d4a-4b30-8d43-fd014e4c0a14 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:29.537492 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1e7dce16-1d4a-4b30-8d43-fd014e4c0a14 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:29.538486 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1e7dce16-1d4a-4b30-8d43-fd014e4c0a14 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:29.554011 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-cf367a13-afac-420e-b4fd-0113e3a0c582 req-063f6444-2f70-453b-bd4e-74857c19ed7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635ee3bb-dc82-4d25-95fc-ef55d01f0705", "name": "network-vif-plugged", "status": "completed", "tag": "d48abd91-ed3c-4f04-8767-5e6f0211d6fe"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:29.557505 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:52:29.557505 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:52:29.569518 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-cf367a13-afac-420e-b4fd-0113e3a0c582 req-063f6444-2f70-453b-bd4e-74857c19ed7b service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:29.574030 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-cf367a13-afac-420e-b4fd-0113e3a0c582 req-063f6444-2f70-453b-bd4e-74857c19ed7b service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:29.599366 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-cf367a13-afac-420e-b4fd-0113e3a0c582 req-063f6444-2f70-453b-bd4e-74857c19ed7b service nova] Creating event network-vif-plugged:d48abd91-ed3c-4f04-8767-5e6f0211d6fe for instance 635ee3bb-dc82-4d25-95fc-ef55d01f0705 on hv-cinder-78447 Dec 16 15:52:29.612450 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-cf367a13-afac-420e-b4fd-0113e3a0c582 req-063f6444-2f70-453b-bd4e-74857c19ed7b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063884 Dec 16 15:52:29.614109 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 290/624] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:52:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:52:29.882458 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-1e7dce16-1d4a-4b30-8d43-fd014e4c0a14 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:29.898475 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-1e7dce16-1d4a-4b30-8d43-fd014e4c0a14 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:29.905488 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-1e7dce16-1d4a-4b30-8d43-fd014e4c0a14 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:29.911389 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-1e7dce16-1d4a-4b30-8d43-fd014e4c0a14 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1407 microversion: 2.20 time: 0.393315 Dec 16 15:52:29.921779 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 335/625] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:52:29 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1407 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:52:30.939898 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-6b32a35f-1604-45f5-a013-ef22637cee31 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:30.940705 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-6b32a35f-1604-45f5-a013-ef22637cee31 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:30.947744 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6b32a35f-1604-45f5-a013-ef22637cee31 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:30.948184 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6b32a35f-1604-45f5-a013-ef22637cee31 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:30.948957 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6b32a35f-1604-45f5-a013-ef22637cee31 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:30.949382 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6b32a35f-1604-45f5-a013-ef22637cee31 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:31.091033 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-6b32a35f-1604-45f5-a013-ef22637cee31 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:31.099843 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-6b32a35f-1604-45f5-a013-ef22637cee31 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:31.101594 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-6b32a35f-1604-45f5-a013-ef22637cee31 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:31.102890 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-6b32a35f-1604-45f5-a013-ef22637cee31 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1407 microversion: 2.20 time: 0.167047 Dec 16 15:52:31.103742 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 291/626] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:52:30 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:52:32.120202 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-dd0b0718-2083-4ec8-9dfd-6212da1f5013 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:32.120844 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-dd0b0718-2083-4ec8-9dfd-6212da1f5013 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:32.131382 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-dd0b0718-2083-4ec8-9dfd-6212da1f5013 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:32.131822 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-dd0b0718-2083-4ec8-9dfd-6212da1f5013 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:32.132609 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-dd0b0718-2083-4ec8-9dfd-6212da1f5013 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:32.133032 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-dd0b0718-2083-4ec8-9dfd-6212da1f5013 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:32.267140 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-dd0b0718-2083-4ec8-9dfd-6212da1f5013 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:32.276013 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-dd0b0718-2083-4ec8-9dfd-6212da1f5013 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:32.277872 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-dd0b0718-2083-4ec8-9dfd-6212da1f5013 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:32.279096 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-dd0b0718-2083-4ec8-9dfd-6212da1f5013 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1600 microversion: 2.20 time: 0.162765 Dec 16 15:52:32.279738 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 336/627] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:52:32 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:52:32.296975 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-60de8fe0-e3fe-4df5-ac91-de2dc903c27b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:32.297602 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-60de8fe0-e3fe-4df5-ac91-de2dc903c27b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:32.304206 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-60de8fe0-e3fe-4df5-ac91-de2dc903c27b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:32.304656 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-60de8fe0-e3fe-4df5-ac91-de2dc903c27b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:32.305456 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-60de8fe0-e3fe-4df5-ac91-de2dc903c27b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:32.305893 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-60de8fe0-e3fe-4df5-ac91-de2dc903c27b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:32.391019 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-60de8fe0-e3fe-4df5-ac91-de2dc903c27b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.097837 Dec 16 15:52:32.391584 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 292/628] 10.222.0.31 () {60 vars in 1315 bytes} [Thu Dec 16 15:52:32 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:52:33.520811 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-a7121d95-8529-40ea-bc9a-06a0211f9d4c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:33.522344 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-a7121d95-8529-40ea-bc9a-06a0211f9d4c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:33.524659 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-1b3f4ba7-2981-4f58-9f3f-adec1c7b2135 req-14db8500-2c97-4e54-9e71-0ee335660519 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "635ee3bb-dc82-4d25-95fc-ef55d01f0705", "tag": "d48abd91-ed3c-4f04-8767-5e6f0211d6fe"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:33.526430 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:52:33.526430 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:52:33.528761 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a7121d95-8529-40ea-bc9a-06a0211f9d4c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:33.529189 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a7121d95-8529-40ea-bc9a-06a0211f9d4c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:33.530181 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a7121d95-8529-40ea-bc9a-06a0211f9d4c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:33.530791 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a7121d95-8529-40ea-bc9a-06a0211f9d4c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:33.540104 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-1b3f4ba7-2981-4f58-9f3f-adec1c7b2135 req-14db8500-2c97-4e54-9e71-0ee335660519 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:33.540545 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-1b3f4ba7-2981-4f58-9f3f-adec1c7b2135 req-14db8500-2c97-4e54-9e71-0ee335660519 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:33.555048 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-1b3f4ba7-2981-4f58-9f3f-adec1c7b2135 req-14db8500-2c97-4e54-9e71-0ee335660519 service nova] Creating event network-changed:d48abd91-ed3c-4f04-8767-5e6f0211d6fe for instance 635ee3bb-dc82-4d25-95fc-ef55d01f0705 on hv-cinder-78447 Dec 16 15:52:33.561504 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-1b3f4ba7-2981-4f58-9f3f-adec1c7b2135 req-14db8500-2c97-4e54-9e71-0ee335660519 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040605 Dec 16 15:52:33.562198 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 293/629] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:52:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:52:33.620059 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-a7121d95-8529-40ea-bc9a-06a0211f9d4c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 14 microversion: 2.20 time: 0.102750 Dec 16 15:52:33.623440 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 337/630] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:52:33 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:34.633841 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-e6e960fd-baa2-42c5-a420-0aef5a37745a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:34.635519 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-e6e960fd-baa2-42c5-a420-0aef5a37745a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:34.644605 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e6e960fd-baa2-42c5-a420-0aef5a37745a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:34.645108 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e6e960fd-baa2-42c5-a420-0aef5a37745a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:34.645955 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e6e960fd-baa2-42c5-a420-0aef5a37745a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:34.646478 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e6e960fd-baa2-42c5-a420-0aef5a37745a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:34.721072 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-e6e960fd-baa2-42c5-a420-0aef5a37745a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 14 microversion: 2.20 time: 0.093176 Dec 16 15:52:34.722721 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 294/631] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:52:34 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:35.737578 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-4af4391f-041c-40e6-aebe-3d7eb548f980 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:35.739293 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-4af4391f-041c-40e6-aebe-3d7eb548f980 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:35.746114 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4af4391f-041c-40e6-aebe-3d7eb548f980 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:35.746567 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4af4391f-041c-40e6-aebe-3d7eb548f980 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:35.747348 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4af4391f-041c-40e6-aebe-3d7eb548f980 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:35.747777 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4af4391f-041c-40e6-aebe-3d7eb548f980 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:35.811355 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-4af4391f-041c-40e6-aebe-3d7eb548f980 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 14 microversion: 2.20 time: 0.080680 Dec 16 15:52:35.811977 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 338/632] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:52:35 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:36.824174 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-f0cfbf8a-8b68-425a-9574-ff14f04e6387 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:36.825183 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-f0cfbf8a-8b68-425a-9574-ff14f04e6387 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:36.832378 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f0cfbf8a-8b68-425a-9574-ff14f04e6387 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:36.832828 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f0cfbf8a-8b68-425a-9574-ff14f04e6387 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:36.833658 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f0cfbf8a-8b68-425a-9574-ff14f04e6387 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:36.834095 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f0cfbf8a-8b68-425a-9574-ff14f04e6387 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:36.903254 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-f0cfbf8a-8b68-425a-9574-ff14f04e6387 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 14 microversion: 2.20 time: 0.083203 Dec 16 15:52:36.903900 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 295/633] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:52:36 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:37.566100 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-fec98735-4818-483c-bc75-a558779e559f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:37.566716 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-fec98735-4818-483c-bc75-a558779e559f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:37.573734 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-fec98735-4818-483c-bc75-a558779e559f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:37.574185 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-fec98735-4818-483c-bc75-a558779e559f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:37.574999 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-fec98735-4818-483c-bc75-a558779e559f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:37.575462 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-fec98735-4818-483c-bc75-a558779e559f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:37.664676 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.objects.instance [None req-fec98735-4818-483c-bc75-a558779e559f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lazy-loading 'services' on Instance uuid 29bba044-2e01-44b1-bb03-0f367846a5f0 {{(pid=122399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:52:37.738020 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-fec98735-4818-483c-bc75-a558779e559f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "DELETE /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/os-volume_attachments/ac7d25b9-f2e8-4a8b-9bd2-530d487d53cb" status: 202 len: 0 microversion: 2.1 time: 0.176218 Dec 16 15:52:37.738646 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 339/634] 10.222.0.31 () {58 vars in 1415 bytes} [Thu Dec 16 15:52:37 2021] DELETE /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/os-volume_attachments/ac7d25b9-f2e8-4a8b-9bd2-530d487d53cb => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:52:37.916987 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-93c637f7-b795-4cbf-b0e4-02717c468b3a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:37.918077 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-93c637f7-b795-4cbf-b0e4-02717c468b3a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:37.925617 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-93c637f7-b795-4cbf-b0e4-02717c468b3a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:37.926359 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-93c637f7-b795-4cbf-b0e4-02717c468b3a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:37.927241 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-93c637f7-b795-4cbf-b0e4-02717c468b3a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:37.927710 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-93c637f7-b795-4cbf-b0e4-02717c468b3a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:37.998831 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-93c637f7-b795-4cbf-b0e4-02717c468b3a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 14 microversion: 2.20 time: 0.086192 Dec 16 15:52:37.999443 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 296/635] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:52:37 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:38.847207 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-9d2c2955-4afa-4b03-bddb-06481ce992e0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:38.854300 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9d2c2955-4afa-4b03-bddb-06481ce992e0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:38.854927 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9d2c2955-4afa-4b03-bddb-06481ce992e0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:38.920558 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-9d2c2955-4afa-4b03-bddb-06481ce992e0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Going to try to stop instance {{(pid=122399) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 16 15:52:38.968189 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-9d2c2955-4afa-4b03-bddb-06481ce992e0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 202 len: 0 microversion: 2.1 time: 0.126199 Dec 16 15:52:38.968890 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 340/636] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:52:38 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:52:38.977936 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-b725e22e-ffa7-4001-bacc-6495ebbdac56 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:38.978642 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-b725e22e-ffa7-4001-bacc-6495ebbdac56 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:38.986157 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b725e22e-ffa7-4001-bacc-6495ebbdac56 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:38.986617 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b725e22e-ffa7-4001-bacc-6495ebbdac56 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:38.987497 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b725e22e-ffa7-4001-bacc-6495ebbdac56 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:38.987887 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b725e22e-ffa7-4001-bacc-6495ebbdac56 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:39.010639 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-5089acaa-4d59-4d35-8104-a69f425874e7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:39.011702 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-5089acaa-4d59-4d35-8104-a69f425874e7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:39.017801 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5089acaa-4d59-4d35-8104-a69f425874e7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:39.018254 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5089acaa-4d59-4d35-8104-a69f425874e7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:39.019037 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5089acaa-4d59-4d35-8104-a69f425874e7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:39.019646 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5089acaa-4d59-4d35-8104-a69f425874e7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:39.101532 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-5089acaa-4d59-4d35-8104-a69f425874e7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 14 microversion: 2.20 time: 0.094812 Dec 16 15:52:39.102840 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 341/637] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:52:39 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:52:39.154613 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-b725e22e-ffa7-4001-bacc-6495ebbdac56 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:39.162322 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-b725e22e-ffa7-4001-bacc-6495ebbdac56 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1675 microversion: 2.1 time: 0.188494 Dec 16 15:52:39.162983 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 297/638] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:38 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1675 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:40.112696 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-5cb1a623-6c55-4acf-9ccb-d72f23081c3a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:40.113913 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-5cb1a623-6c55-4acf-9ccb-d72f23081c3a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:40.121160 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5cb1a623-6c55-4acf-9ccb-d72f23081c3a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:40.121753 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5cb1a623-6c55-4acf-9ccb-d72f23081c3a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:40.122618 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5cb1a623-6c55-4acf-9ccb-d72f23081c3a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:40.123040 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5cb1a623-6c55-4acf-9ccb-d72f23081c3a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:40.178923 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-bfc6be02-cefa-40ea-a797-071153121687 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:40.179535 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-bfc6be02-cefa-40ea-a797-071153121687 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:40.185984 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-bfc6be02-cefa-40ea-a797-071153121687 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:40.186430 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-bfc6be02-cefa-40ea-a797-071153121687 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:40.187205 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-bfc6be02-cefa-40ea-a797-071153121687 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:40.187640 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-bfc6be02-cefa-40ea-a797-071153121687 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:40.200520 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-5cb1a623-6c55-4acf-9ccb-d72f23081c3a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 14 microversion: 2.20 time: 0.091711 Dec 16 15:52:40.203707 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 342/639] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:52:40 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:40.322402 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-bfc6be02-cefa-40ea-a797-071153121687 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:40.330111 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-bfc6be02-cefa-40ea-a797-071153121687 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1675 microversion: 2.1 time: 0.154886 Dec 16 15:52:40.330682 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 298/640] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:40 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:52:41.211811 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-75617131-68a6-49fe-b0d0-ed652155ce02 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:41.212811 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-75617131-68a6-49fe-b0d0-ed652155ce02 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:41.219910 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-75617131-68a6-49fe-b0d0-ed652155ce02 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:41.220352 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-75617131-68a6-49fe-b0d0-ed652155ce02 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:41.221146 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-75617131-68a6-49fe-b0d0-ed652155ce02 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:41.221611 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-75617131-68a6-49fe-b0d0-ed652155ce02 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:41.301339 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-75617131-68a6-49fe-b0d0-ed652155ce02 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 14 microversion: 2.20 time: 0.093384 Dec 16 15:52:41.302114 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 343/641] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:52:41 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:41.348621 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-957ac2be-f9b8-4f4b-9f49-7d7467d49dcc tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:41.349161 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-957ac2be-f9b8-4f4b-9f49-7d7467d49dcc tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:41.355341 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-957ac2be-f9b8-4f4b-9f49-7d7467d49dcc tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:41.355784 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-957ac2be-f9b8-4f4b-9f49-7d7467d49dcc tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:41.356663 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-957ac2be-f9b8-4f4b-9f49-7d7467d49dcc tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:41.357092 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-957ac2be-f9b8-4f4b-9f49-7d7467d49dcc tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:41.490250 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-957ac2be-f9b8-4f4b-9f49-7d7467d49dcc tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:41.497516 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-957ac2be-f9b8-4f4b-9f49-7d7467d49dcc tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1675 microversion: 2.1 time: 0.153262 Dec 16 15:52:41.498612 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 299/642] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:41 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:42.317639 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-a5d8694d-b144-472b-8cdf-7492a63cac94 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:42.319989 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-a5d8694d-b144-472b-8cdf-7492a63cac94 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:42.333185 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a5d8694d-b144-472b-8cdf-7492a63cac94 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:42.334235 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a5d8694d-b144-472b-8cdf-7492a63cac94 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:42.335545 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a5d8694d-b144-472b-8cdf-7492a63cac94 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:42.336265 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a5d8694d-b144-472b-8cdf-7492a63cac94 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:42.398827 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-a5d8694d-b144-472b-8cdf-7492a63cac94 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 14 microversion: 2.20 time: 0.087953 Dec 16 15:52:42.399513 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 344/643] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:52:42 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:42.515142 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-9dd2c53f-f74e-42b8-bb66-710225090341 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:42.515836 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-9dd2c53f-f74e-42b8-bb66-710225090341 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:42.523309 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9dd2c53f-f74e-42b8-bb66-710225090341 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:42.523766 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9dd2c53f-f74e-42b8-bb66-710225090341 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:42.524599 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9dd2c53f-f74e-42b8-bb66-710225090341 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:42.525038 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9dd2c53f-f74e-42b8-bb66-710225090341 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:42.911961 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-9dd2c53f-f74e-42b8-bb66-710225090341 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:42.919748 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-9dd2c53f-f74e-42b8-bb66-710225090341 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1675 microversion: 2.1 time: 0.408322 Dec 16 15:52:42.920356 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 300/644] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:42 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1675 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:43.410762 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-86744123-87ae-45d0-844a-9caf2d16dcd5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:43.411803 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-86744123-87ae-45d0-844a-9caf2d16dcd5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:43.419450 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-86744123-87ae-45d0-844a-9caf2d16dcd5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:43.419878 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-86744123-87ae-45d0-844a-9caf2d16dcd5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:43.420678 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-86744123-87ae-45d0-844a-9caf2d16dcd5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:43.421103 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-86744123-87ae-45d0-844a-9caf2d16dcd5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:43.487338 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-86744123-87ae-45d0-844a-9caf2d16dcd5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 14 microversion: 2.20 time: 0.080438 Dec 16 15:52:43.487894 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 345/645] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:52:43 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:43.937728 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-9d1ebe98-45c4-4a18-b5b1-ffdcb7001862 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:43.938675 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-9d1ebe98-45c4-4a18-b5b1-ffdcb7001862 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:43.946066 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9d1ebe98-45c4-4a18-b5b1-ffdcb7001862 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:43.946517 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9d1ebe98-45c4-4a18-b5b1-ffdcb7001862 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:43.947286 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9d1ebe98-45c4-4a18-b5b1-ffdcb7001862 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:43.947950 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9d1ebe98-45c4-4a18-b5b1-ffdcb7001862 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:44.080552 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-9d1ebe98-45c4-4a18-b5b1-ffdcb7001862 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:44.096312 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-9d1ebe98-45c4-4a18-b5b1-ffdcb7001862 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1675 microversion: 2.1 time: 0.162643 Dec 16 15:52:44.097122 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 301/646] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:43 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:44.499123 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-2a4f3204-14a8-4c8d-b4bc-6703c5424ffc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:44.500850 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-2a4f3204-14a8-4c8d-b4bc-6703c5424ffc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:44.508399 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2a4f3204-14a8-4c8d-b4bc-6703c5424ffc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:44.508880 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2a4f3204-14a8-4c8d-b4bc-6703c5424ffc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:44.509724 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2a4f3204-14a8-4c8d-b4bc-6703c5424ffc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:44.510353 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2a4f3204-14a8-4c8d-b4bc-6703c5424ffc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:44.572647 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-2a4f3204-14a8-4c8d-b4bc-6703c5424ffc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 14 microversion: 2.20 time: 0.077465 Dec 16 15:52:44.573485 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 346/647] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:52:44 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:45.117138 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-2701a7fd-d28c-48a2-a39c-5812aa21d59d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:45.117789 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-2701a7fd-d28c-48a2-a39c-5812aa21d59d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:45.125509 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2701a7fd-d28c-48a2-a39c-5812aa21d59d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:45.125965 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2701a7fd-d28c-48a2-a39c-5812aa21d59d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:45.126863 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2701a7fd-d28c-48a2-a39c-5812aa21d59d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:45.127429 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2701a7fd-d28c-48a2-a39c-5812aa21d59d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:45.267582 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-2701a7fd-d28c-48a2-a39c-5812aa21d59d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:45.275456 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-2701a7fd-d28c-48a2-a39c-5812aa21d59d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1675 microversion: 2.1 time: 0.164323 Dec 16 15:52:45.276023 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 302/648] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:45 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:45.584031 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-6469c192-aacb-4581-9aaa-17b69b548e97 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:45.585045 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-6469c192-aacb-4581-9aaa-17b69b548e97 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:45.592372 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6469c192-aacb-4581-9aaa-17b69b548e97 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:45.592824 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6469c192-aacb-4581-9aaa-17b69b548e97 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:45.593649 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6469c192-aacb-4581-9aaa-17b69b548e97 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:45.594086 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6469c192-aacb-4581-9aaa-17b69b548e97 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:45.664308 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-6469c192-aacb-4581-9aaa-17b69b548e97 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 14 microversion: 2.20 time: 0.084227 Dec 16 15:52:45.665009 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 347/649] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:52:45 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:46.300212 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-babc923e-053c-4b3b-903a-1e31d2e731a4 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:46.300837 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-babc923e-053c-4b3b-903a-1e31d2e731a4 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:46.307856 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-babc923e-053c-4b3b-903a-1e31d2e731a4 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:46.308303 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-babc923e-053c-4b3b-903a-1e31d2e731a4 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:46.309092 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-babc923e-053c-4b3b-903a-1e31d2e731a4 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:46.309801 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-babc923e-053c-4b3b-903a-1e31d2e731a4 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:46.445857 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-babc923e-053c-4b3b-903a-1e31d2e731a4 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:46.453686 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-babc923e-053c-4b3b-903a-1e31d2e731a4 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1675 microversion: 2.1 time: 0.158059 Dec 16 15:52:46.454285 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 303/650] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:46 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:46.677810 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-3e9e91da-2083-46ac-84ac-d4d924c6a48d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:46.678748 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-3e9e91da-2083-46ac-84ac-d4d924c6a48d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:46.686188 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3e9e91da-2083-46ac-84ac-d4d924c6a48d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:46.686664 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3e9e91da-2083-46ac-84ac-d4d924c6a48d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:46.687446 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3e9e91da-2083-46ac-84ac-d4d924c6a48d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:46.687863 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3e9e91da-2083-46ac-84ac-d4d924c6a48d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:46.763782 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-3e9e91da-2083-46ac-84ac-d4d924c6a48d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 14 microversion: 2.20 time: 0.090455 Dec 16 15:52:46.766971 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 348/651] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:52:46 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:47.472020 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-895c5838-c737-4fc8-9a23-785fa001d009 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:47.472712 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-895c5838-c737-4fc8-9a23-785fa001d009 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:47.480507 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-895c5838-c737-4fc8-9a23-785fa001d009 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:47.480951 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-895c5838-c737-4fc8-9a23-785fa001d009 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:47.481781 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-895c5838-c737-4fc8-9a23-785fa001d009 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:47.482218 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-895c5838-c737-4fc8-9a23-785fa001d009 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:47.624882 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-895c5838-c737-4fc8-9a23-785fa001d009 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:47.632799 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-895c5838-c737-4fc8-9a23-785fa001d009 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1675 microversion: 2.1 time: 0.165306 Dec 16 15:52:47.633378 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 304/652] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:47 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:47.776620 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-1e18d48f-4972-4366-9d81-5915ee36abc6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:47.777635 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-1e18d48f-4972-4366-9d81-5915ee36abc6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:47.784676 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1e18d48f-4972-4366-9d81-5915ee36abc6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:47.785112 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1e18d48f-4972-4366-9d81-5915ee36abc6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:47.785908 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1e18d48f-4972-4366-9d81-5915ee36abc6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:47.786330 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1e18d48f-4972-4366-9d81-5915ee36abc6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:47.855557 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-1e18d48f-4972-4366-9d81-5915ee36abc6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 14 microversion: 2.20 time: 0.083466 Dec 16 15:52:47.856078 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 349/653] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:52:47 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:48.652743 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-17103a19-0eeb-449f-8b00-38f84a3b4a46 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:48.653467 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-17103a19-0eeb-449f-8b00-38f84a3b4a46 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:48.663767 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-17103a19-0eeb-449f-8b00-38f84a3b4a46 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:48.664410 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-17103a19-0eeb-449f-8b00-38f84a3b4a46 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:48.665698 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-17103a19-0eeb-449f-8b00-38f84a3b4a46 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:48.666316 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-17103a19-0eeb-449f-8b00-38f84a3b4a46 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:48.805043 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-17103a19-0eeb-449f-8b00-38f84a3b4a46 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:48.812695 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-17103a19-0eeb-449f-8b00-38f84a3b4a46 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1675 microversion: 2.1 time: 0.165720 Dec 16 15:52:48.813271 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 305/654] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:48 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:48.867477 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-6afa8a0e-619c-4fe5-b96c-3ffbb4440889 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:48.868667 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-6afa8a0e-619c-4fe5-b96c-3ffbb4440889 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:48.876133 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6afa8a0e-619c-4fe5-b96c-3ffbb4440889 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:48.876589 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6afa8a0e-619c-4fe5-b96c-3ffbb4440889 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:48.877357 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6afa8a0e-619c-4fe5-b96c-3ffbb4440889 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:48.877815 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6afa8a0e-619c-4fe5-b96c-3ffbb4440889 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:48.962607 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-6afa8a0e-619c-4fe5-b96c-3ffbb4440889 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 4712 microversion: 2.20 time: 0.098992 Dec 16 15:52:48.963261 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 350/655] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:52:48 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 4712 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:52:49.829155 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-6707c412-daf7-417e-94f1-e207851a320b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:49.829778 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-6707c412-daf7-417e-94f1-e207851a320b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:49.836165 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6707c412-daf7-417e-94f1-e207851a320b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:49.836606 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6707c412-daf7-417e-94f1-e207851a320b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:49.837381 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6707c412-daf7-417e-94f1-e207851a320b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:49.837842 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6707c412-daf7-417e-94f1-e207851a320b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:49.969214 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-6707c412-daf7-417e-94f1-e207851a320b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:49.974711 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-75a94ed0-ebe8-4112-99aa-1e7df0b37be4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:49.975715 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-75a94ed0-ebe8-4112-99aa-1e7df0b37be4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:49.977516 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-6707c412-daf7-417e-94f1-e207851a320b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1652 microversion: 2.1 time: 0.152017 Dec 16 15:52:49.978087 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 306/656] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:49 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1652 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:49.982613 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-75a94ed0-ebe8-4112-99aa-1e7df0b37be4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:49.983053 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-75a94ed0-ebe8-4112-99aa-1e7df0b37be4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:49.983827 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-75a94ed0-ebe8-4112-99aa-1e7df0b37be4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:49.984250 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-75a94ed0-ebe8-4112-99aa-1e7df0b37be4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:49.993942 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-1da8a76b-5c82-4c32-94dd-38fd42d24c02 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:50.000453 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1da8a76b-5c82-4c32-94dd-38fd42d24c02 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:50.000932 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1da8a76b-5c82-4c32-94dd-38fd42d24c02 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:50.023167 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-1da8a76b-5c82-4c32-94dd-38fd42d24c02 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Going to try to start instance {{(pid=122398) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 16 15:52:50.063251 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-75a94ed0-ebe8-4112-99aa-1e7df0b37be4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 11629 microversion: 2.20 time: 0.092759 Dec 16 15:52:50.064647 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 351/657] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:52:49 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 11629 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 15:52:50.066445 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-1da8a76b-5c82-4c32-94dd-38fd42d24c02 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action" status: 202 len: 0 microversion: 2.1 time: 0.075983 Dec 16 15:52:50.069569 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 307/658] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:52:49 2021] POST /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:52:50.075921 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-f10beb69-b6b4-4cc8-86ce-8610ab234b1e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:50.076620 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-f10beb69-b6b4-4cc8-86ce-8610ab234b1e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:50.083876 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f10beb69-b6b4-4cc8-86ce-8610ab234b1e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:50.084368 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f10beb69-b6b4-4cc8-86ce-8610ab234b1e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:50.085159 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f10beb69-b6b4-4cc8-86ce-8610ab234b1e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:50.085638 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f10beb69-b6b4-4cc8-86ce-8610ab234b1e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:50.248611 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-f10beb69-b6b4-4cc8-86ce-8610ab234b1e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:50.256851 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-f10beb69-b6b4-4cc8-86ce-8610ab234b1e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1661 microversion: 2.1 time: 0.185069 Dec 16 15:52:50.258091 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 352/659] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:50 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1661 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:52:51.075665 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-68b6e5e1-de0e-4446-8511-4656db9284b4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:51.076744 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-68b6e5e1-de0e-4446-8511-4656db9284b4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:51.083637 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-68b6e5e1-de0e-4446-8511-4656db9284b4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:51.084125 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-68b6e5e1-de0e-4446-8511-4656db9284b4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:51.084923 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-68b6e5e1-de0e-4446-8511-4656db9284b4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:51.085357 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-68b6e5e1-de0e-4446-8511-4656db9284b4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:51.175033 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-68b6e5e1-de0e-4446-8511-4656db9284b4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 15297 microversion: 2.20 time: 0.103027 Dec 16 15:52:51.176061 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 308/660] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:52:51 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 15297 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:52:51.278353 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-1c613ec2-59bb-40c6-9ad3-a681dca33836 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:51.279148 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-1c613ec2-59bb-40c6-9ad3-a681dca33836 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:51.286421 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1c613ec2-59bb-40c6-9ad3-a681dca33836 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:51.287064 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1c613ec2-59bb-40c6-9ad3-a681dca33836 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:51.288077 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1c613ec2-59bb-40c6-9ad3-a681dca33836 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:51.288682 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1c613ec2-59bb-40c6-9ad3-a681dca33836 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:51.426801 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-1c613ec2-59bb-40c6-9ad3-a681dca33836 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:51.434605 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-1c613ec2-59bb-40c6-9ad3-a681dca33836 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1661 microversion: 2.1 time: 0.162564 Dec 16 15:52:51.435227 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 353/661] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:51 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1661 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:52.190142 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-280a583b-efb6-4dcd-9985-c6b48c3becc8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:52.191263 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-280a583b-efb6-4dcd-9985-c6b48c3becc8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:52.198402 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-280a583b-efb6-4dcd-9985-c6b48c3becc8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:52.198849 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-280a583b-efb6-4dcd-9985-c6b48c3becc8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:52.199624 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-280a583b-efb6-4dcd-9985-c6b48c3becc8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:52.200060 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-280a583b-efb6-4dcd-9985-c6b48c3becc8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:52.278602 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-280a583b-efb6-4dcd-9985-c6b48c3becc8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 17861 microversion: 2.20 time: 0.092430 Dec 16 15:52:52.279370 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 309/662] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:52:52 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 17861 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:52:52.452462 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-1c52fd2c-e0e4-4104-baa1-7debe56298b8 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:52:52.453024 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-1c52fd2c-e0e4-4104-baa1-7debe56298b8 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:52.460395 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1c52fd2c-e0e4-4104-baa1-7debe56298b8 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:52.461085 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1c52fd2c-e0e4-4104-baa1-7debe56298b8 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:52.462255 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1c52fd2c-e0e4-4104-baa1-7debe56298b8 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:52.462836 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1c52fd2c-e0e4-4104-baa1-7debe56298b8 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:52.604233 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-1c52fd2c-e0e4-4104-baa1-7debe56298b8 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:52:52.612697 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-1c52fd2c-e0e4-4104-baa1-7debe56298b8 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1665 microversion: 2.1 time: 0.164691 Dec 16 15:52:52.613217 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 354/663] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:52:52 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1665 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:52:53.296934 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-a48207b9-453d-4cee-a0f7-8d216f5955d3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:53.298598 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-a48207b9-453d-4cee-a0f7-8d216f5955d3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:53.310196 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a48207b9-453d-4cee-a0f7-8d216f5955d3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:53.310956 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a48207b9-453d-4cee-a0f7-8d216f5955d3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:53.312253 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a48207b9-453d-4cee-a0f7-8d216f5955d3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:53.312968 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a48207b9-453d-4cee-a0f7-8d216f5955d3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:53.398869 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-a48207b9-453d-4cee-a0f7-8d216f5955d3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 18663 microversion: 2.20 time: 0.108672 Dec 16 15:52:53.399878 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 310/664] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:52:53 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 18663 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:52:54.416788 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-a9910c4c-e987-4050-bd6d-437897b42e39 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:54.418187 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-a9910c4c-e987-4050-bd6d-437897b42e39 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:54.428723 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a9910c4c-e987-4050-bd6d-437897b42e39 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:54.429473 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a9910c4c-e987-4050-bd6d-437897b42e39 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:54.430782 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a9910c4c-e987-4050-bd6d-437897b42e39 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:54.431489 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a9910c4c-e987-4050-bd6d-437897b42e39 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:54.527983 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-a9910c4c-e987-4050-bd6d-437897b42e39 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 20997 microversion: 2.20 time: 0.117686 Dec 16 15:52:54.528685 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 355/665] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:52:54 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 20997 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:52:55.543299 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-0dcaec50-9541-40e9-807d-2d844e9c6a06 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:55.544529 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-0dcaec50-9541-40e9-807d-2d844e9c6a06 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:55.551755 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0dcaec50-9541-40e9-807d-2d844e9c6a06 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:55.552195 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0dcaec50-9541-40e9-807d-2d844e9c6a06 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:55.552959 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0dcaec50-9541-40e9-807d-2d844e9c6a06 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:55.553392 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0dcaec50-9541-40e9-807d-2d844e9c6a06 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:55.629310 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-0dcaec50-9541-40e9-807d-2d844e9c6a06 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 22764 microversion: 2.20 time: 0.092684 Dec 16 15:52:55.630326 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 311/666] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:52:55 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 22764 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:52:56.646324 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-80592390-6e62-48d1-8f18-f1e3c002ce7a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:56.648078 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-80592390-6e62-48d1-8f18-f1e3c002ce7a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:56.657365 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-80592390-6e62-48d1-8f18-f1e3c002ce7a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:56.657847 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-80592390-6e62-48d1-8f18-f1e3c002ce7a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:56.658625 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-80592390-6e62-48d1-8f18-f1e3c002ce7a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:56.659054 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-80592390-6e62-48d1-8f18-f1e3c002ce7a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:56.738858 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-80592390-6e62-48d1-8f18-f1e3c002ce7a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 23803 microversion: 2.20 time: 0.098985 Dec 16 15:52:56.739841 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 356/667] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:52:56 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 23803 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:52:57.757690 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-2e66397c-e902-4394-a95f-d86f894a34c2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:52:57.759194 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-2e66397c-e902-4394-a95f-d86f894a34c2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:52:57.767783 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2e66397c-e902-4394-a95f-d86f894a34c2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:57.768238 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2e66397c-e902-4394-a95f-d86f894a34c2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:52:57.769009 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2e66397c-e902-4394-a95f-d86f894a34c2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:52:57.769445 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2e66397c-e902-4394-a95f-d86f894a34c2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:00.279279 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-2e66397c-e902-4394-a95f-d86f894a34c2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 27560 microversion: 2.20 time: 2.527940 Dec 16 15:53:00.280407 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 312/668] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:52:57 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 27560 bytes in 2531 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:53:01.296911 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-b8af179f-0844-4227-9087-614790ec5cee tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:01.297965 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-b8af179f-0844-4227-9087-614790ec5cee tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:01.305159 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b8af179f-0844-4227-9087-614790ec5cee tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:01.305659 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b8af179f-0844-4227-9087-614790ec5cee tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:01.306434 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b8af179f-0844-4227-9087-614790ec5cee tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:01.306865 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b8af179f-0844-4227-9087-614790ec5cee tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:01.391214 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-b8af179f-0844-4227-9087-614790ec5cee tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 27910 microversion: 2.20 time: 0.099552 Dec 16 15:53:01.391851 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 357/669] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:53:01 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 27910 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:53:02.405543 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-f5b42dd8-85c6-4a73-9f1e-d2070df87bdc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:02.406448 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-f5b42dd8-85c6-4a73-9f1e-d2070df87bdc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:02.416366 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f5b42dd8-85c6-4a73-9f1e-d2070df87bdc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:02.416807 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f5b42dd8-85c6-4a73-9f1e-d2070df87bdc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:02.417775 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f5b42dd8-85c6-4a73-9f1e-d2070df87bdc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:02.418208 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f5b42dd8-85c6-4a73-9f1e-d2070df87bdc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:02.493642 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-f5b42dd8-85c6-4a73-9f1e-d2070df87bdc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 28272 microversion: 2.20 time: 0.093306 Dec 16 15:53:02.494287 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 313/670] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:53:02 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 28272 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:53:03.506610 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-935cac0c-d0a4-4425-bc65-aa8a41056b85 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:03.507619 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-935cac0c-d0a4-4425-bc65-aa8a41056b85 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:03.514843 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-935cac0c-d0a4-4425-bc65-aa8a41056b85 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:03.515290 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-935cac0c-d0a4-4425-bc65-aa8a41056b85 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:03.516073 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-935cac0c-d0a4-4425-bc65-aa8a41056b85 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:03.516505 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-935cac0c-d0a4-4425-bc65-aa8a41056b85 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:03.580212 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-935cac0c-d0a4-4425-bc65-aa8a41056b85 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 28272 microversion: 2.20 time: 0.077661 Dec 16 15:53:03.580855 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 358/671] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:53:03 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 28272 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:53:04.598161 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-e142b76d-457d-47be-aa7c-ab11d46f5492 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:04.599690 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-e142b76d-457d-47be-aa7c-ab11d46f5492 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:04.611432 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e142b76d-457d-47be-aa7c-ab11d46f5492 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:04.612171 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e142b76d-457d-47be-aa7c-ab11d46f5492 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:04.613478 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e142b76d-457d-47be-aa7c-ab11d46f5492 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:04.614217 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e142b76d-457d-47be-aa7c-ab11d46f5492 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:04.702905 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-e142b76d-457d-47be-aa7c-ab11d46f5492 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 28563 microversion: 2.20 time: 0.111786 Dec 16 15:53:04.703917 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 314/672] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:53:04 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 28563 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:53:05.722241 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-e5192cd3-220b-4285-859b-bd7c102bd7b4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:05.724231 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-e5192cd3-220b-4285-859b-bd7c102bd7b4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:05.734636 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e5192cd3-220b-4285-859b-bd7c102bd7b4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:05.735079 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e5192cd3-220b-4285-859b-bd7c102bd7b4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:05.735871 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e5192cd3-220b-4285-859b-bd7c102bd7b4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:05.736302 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e5192cd3-220b-4285-859b-bd7c102bd7b4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:05.817242 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-e5192cd3-220b-4285-859b-bd7c102bd7b4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 28731 microversion: 2.20 time: 0.101621 Dec 16 15:53:05.818234 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 359/673] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:53:05 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 28731 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:53:06.832009 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-ade5da4a-09f5-450b-b4a3-4cbaebe15e01 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:06.833146 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-ade5da4a-09f5-450b-b4a3-4cbaebe15e01 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:06.840450 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ade5da4a-09f5-450b-b4a3-4cbaebe15e01 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:06.840934 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ade5da4a-09f5-450b-b4a3-4cbaebe15e01 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:06.841819 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ade5da4a-09f5-450b-b4a3-4cbaebe15e01 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:06.842300 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ade5da4a-09f5-450b-b4a3-4cbaebe15e01 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:06.906237 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-ade5da4a-09f5-450b-b4a3-4cbaebe15e01 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 28731 microversion: 2.20 time: 0.078587 Dec 16 15:53:06.906917 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 315/674] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:53:06 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 28731 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:53:07.918726 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-6515eba1-df59-4a96-a9c5-05927ac37b3d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:07.919710 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-6515eba1-df59-4a96-a9c5-05927ac37b3d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:07.927026 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6515eba1-df59-4a96-a9c5-05927ac37b3d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:07.927475 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6515eba1-df59-4a96-a9c5-05927ac37b3d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:07.928262 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6515eba1-df59-4a96-a9c5-05927ac37b3d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:07.928697 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6515eba1-df59-4a96-a9c5-05927ac37b3d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:08.008640 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-6515eba1-df59-4a96-a9c5-05927ac37b3d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 28731 microversion: 2.20 time: 0.093870 Dec 16 15:53:08.009293 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 360/675] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:53:07 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 28731 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:53:09.025492 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-be32fc3b-9429-45f8-ab61-1fc3ec12bb49 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:09.027156 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-be32fc3b-9429-45f8-ab61-1fc3ec12bb49 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:09.036649 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-be32fc3b-9429-45f8-ab61-1fc3ec12bb49 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:09.037099 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-be32fc3b-9429-45f8-ab61-1fc3ec12bb49 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:09.037985 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-be32fc3b-9429-45f8-ab61-1fc3ec12bb49 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:09.038541 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-be32fc3b-9429-45f8-ab61-1fc3ec12bb49 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:09.109005 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-be32fc3b-9429-45f8-ab61-1fc3ec12bb49 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 28731 microversion: 2.20 time: 0.090135 Dec 16 15:53:09.109682 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 316/676] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:53:09 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 28731 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:53:09.656919 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-4972ef1d-36bd-432b-996d-a2c545483cae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-432265888", "imageRef": "2a1434ad-0c2c-4725-baad-a605624baf01", "flavorRef": "452", "networks": [{"uuid": "50d8a135-3436-4a59-8ee6-c5d9e712c029"}]}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:09.716817 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.network.neutron [None req-4972ef1d-36bd-432b-996d-a2c545483cae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] validate_networks() for [('50d8a135-3436-4a59-8ee6-c5d9e712c029', None, None, None, None, None)] {{(pid=122399) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 15:53:10.077810 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-4972ef1d-36bd-432b-996d-a2c545483cae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Flavor limits 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 15:53:10.078225 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-4972ef1d-36bd-432b-996d-a2c545483cae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Image limits 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 15:53:10.078682 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-4972ef1d-36bd-432b-996d-a2c545483cae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Flavor pref 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 15:53:10.079081 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-4972ef1d-36bd-432b-996d-a2c545483cae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Image pref 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 15:53:10.079485 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-4972ef1d-36bd-432b-996d-a2c545483cae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 15:53:10.089185 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4972ef1d-36bd-432b-996d-a2c545483cae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:10.089596 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4972ef1d-36bd-432b-996d-a2c545483cae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:10.090395 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4972ef1d-36bd-432b-996d-a2c545483cae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:10.090804 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4972ef1d-36bd-432b-996d-a2c545483cae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:10.108247 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-4972ef1d-36bd-432b-996d-a2c545483cae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Getting quotas for project ebf339789c6548249d10a3fc90824375. Resources: {'instances', 'ram', 'cores'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:53:10.112629 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-4972ef1d-36bd-432b-996d-a2c545483cae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Getting quotas for user 7a62c94ccf894508af39e5dda01c2dd4 and project ebf339789c6548249d10a3fc90824375. Resources: {'instances', 'ram', 'cores'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:53:10.120844 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-a14fa26e-3013-48b4-83ef-be1f94b7c6c1 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:10.121898 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-a14fa26e-3013-48b4-83ef-be1f94b7c6c1 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:10.124637 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-4972ef1d-36bd-432b-996d-a2c545483cae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Going to run 1 instances... {{(pid=122399) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 15:53:10.127214 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-4972ef1d-36bd-432b-996d-a2c545483cae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: 1f27297a-359e-4f6d-b435-8c0c7ce84163] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a1434ad-0c2c-4725-baad-a605624baf01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 15:53:10.128966 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a14fa26e-3013-48b4-83ef-be1f94b7c6c1 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:10.129443 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a14fa26e-3013-48b4-83ef-be1f94b7c6c1 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:10.130277 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a14fa26e-3013-48b4-83ef-be1f94b7c6c1 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:10.130705 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a14fa26e-3013-48b4-83ef-be1f94b7c6c1 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:10.170177 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-4972ef1d-36bd-432b-996d-a2c545483cae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519710 Dec 16 15:53:10.170817 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 361/677] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Dec 16 15:53:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 15:53:10.180548 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-38690374-fd27-44eb-8cc3-06026e012e0d tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:10.181217 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-38690374-fd27-44eb-8cc3-06026e012e0d tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: 1f27297a-359e-4f6d-b435-8c0c7ce84163] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:10.209971 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-a14fa26e-3013-48b4-83ef-be1f94b7c6c1 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 29080 microversion: 2.20 time: 0.092999 Dec 16 15:53:10.210850 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 317/678] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:53:10 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 29080 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:53:10.235089 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-38690374-fd27-44eb-8cc3-06026e012e0d tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:10.241918 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-38690374-fd27-44eb-8cc3-06026e012e0d tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163" status: 200 len: 1218 microversion: 2.1 time: 0.064865 Dec 16 15:53:10.242486 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 362/679] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:53:10 2021] GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163 => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:53:11.222575 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-f15b2bf2-6643-4373-b28e-7c48c4806937 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:11.223595 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-f15b2bf2-6643-4373-b28e-7c48c4806937 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:11.230681 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f15b2bf2-6643-4373-b28e-7c48c4806937 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:11.231375 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f15b2bf2-6643-4373-b28e-7c48c4806937 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:11.232162 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f15b2bf2-6643-4373-b28e-7c48c4806937 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:11.232592 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f15b2bf2-6643-4373-b28e-7c48c4806937 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:11.258599 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ccbff6f0-1563-41fb-9c93-a0abddfc5e62 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:11.259349 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-ccbff6f0-1563-41fb-9c93-a0abddfc5e62 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: 1f27297a-359e-4f6d-b435-8c0c7ce84163] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:11.277861 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ccbff6f0-1563-41fb-9c93-a0abddfc5e62 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:11.278825 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ccbff6f0-1563-41fb-9c93-a0abddfc5e62 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:11.279830 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ccbff6f0-1563-41fb-9c93-a0abddfc5e62 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:11.280507 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ccbff6f0-1563-41fb-9c93-a0abddfc5e62 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:11.314956 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-f15b2bf2-6643-4373-b28e-7c48c4806937 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 30824 microversion: 2.20 time: 0.096817 Dec 16 15:53:11.315604 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 318/680] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:53:11 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 30824 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:53:11.352424 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-ccbff6f0-1563-41fb-9c93-a0abddfc5e62 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:11.360429 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-ccbff6f0-1563-41fb-9c93-a0abddfc5e62 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163" status: 200 len: 1276 microversion: 2.1 time: 0.105365 Dec 16 15:53:11.361036 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 363/681] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:53:11 2021] GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163 => generated 1276 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:53:12.326843 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-38f21b0b-a2c4-4a1b-a44c-4f63ef2db939 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:12.327803 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-38f21b0b-a2c4-4a1b-a44c-4f63ef2db939 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:12.335246 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-38f21b0b-a2c4-4a1b-a44c-4f63ef2db939 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:12.335690 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-38f21b0b-a2c4-4a1b-a44c-4f63ef2db939 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:12.336535 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-38f21b0b-a2c4-4a1b-a44c-4f63ef2db939 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:12.336934 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-38f21b0b-a2c4-4a1b-a44c-4f63ef2db939 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:12.379842 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-80b1894e-b5ed-4771-9d3c-2114b6d3cca3 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:12.381126 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-80b1894e-b5ed-4771-9d3c-2114b6d3cca3 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: 1f27297a-359e-4f6d-b435-8c0c7ce84163] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:12.388645 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-80b1894e-b5ed-4771-9d3c-2114b6d3cca3 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:12.389101 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-80b1894e-b5ed-4771-9d3c-2114b6d3cca3 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:12.389928 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-80b1894e-b5ed-4771-9d3c-2114b6d3cca3 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:12.390570 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-80b1894e-b5ed-4771-9d3c-2114b6d3cca3 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:12.432777 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-38f21b0b-a2c4-4a1b-a44c-4f63ef2db939 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 32514 microversion: 2.20 time: 0.109987 Dec 16 15:53:12.433463 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 319/682] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:53:12 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 32514 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:53:12.438543 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-744473e0-2e7b-4bee-9964-ea760f978b42 req-9be43001-1c5f-4dfb-acc3-1978aa184ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f27297a-359e-4f6d-b435-8c0c7ce84163", "tag": "97324e88-36de-449c-857f-bc2d3f7a912d"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:12.440012 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:53:12.440012 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:53:12.447951 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-744473e0-2e7b-4bee-9964-ea760f978b42 req-9be43001-1c5f-4dfb-acc3-1978aa184ab1 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:12.448380 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-744473e0-2e7b-4bee-9964-ea760f978b42 req-9be43001-1c5f-4dfb-acc3-1978aa184ab1 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:12.459181 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-744473e0-2e7b-4bee-9964-ea760f978b42 req-9be43001-1c5f-4dfb-acc3-1978aa184ab1 service nova] Creating event network-changed:97324e88-36de-449c-857f-bc2d3f7a912d for instance 1f27297a-359e-4f6d-b435-8c0c7ce84163 on hv-cinder-78447 Dec 16 15:53:12.463761 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-744473e0-2e7b-4bee-9964-ea760f978b42 req-9be43001-1c5f-4dfb-acc3-1978aa184ab1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028843 Dec 16 15:53:12.464533 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 320/683] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:53:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:53:12.595641 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-80b1894e-b5ed-4771-9d3c-2114b6d3cca3 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:12.604266 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-80b1894e-b5ed-4771-9d3c-2114b6d3cca3 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163" status: 200 len: 1318 microversion: 2.1 time: 0.228426 Dec 16 15:53:12.605030 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 364/684] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:53:12 2021] GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:53:13.445529 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-03d7aa6e-90f5-42e7-a9c1-c65a52caa393 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:13.446486 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-03d7aa6e-90f5-42e7-a9c1-c65a52caa393 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:13.452951 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-03d7aa6e-90f5-42e7-a9c1-c65a52caa393 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:13.453399 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-03d7aa6e-90f5-42e7-a9c1-c65a52caa393 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:13.454212 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-03d7aa6e-90f5-42e7-a9c1-c65a52caa393 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:13.454648 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-03d7aa6e-90f5-42e7-a9c1-c65a52caa393 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:13.526455 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-03d7aa6e-90f5-42e7-a9c1-c65a52caa393 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 33333 microversion: 2.20 time: 0.085449 Dec 16 15:53:13.527109 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 321/685] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:53:13 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 33333 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:53:13.628012 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-23ccd9cb-0578-43a0-a634-261d0ccdd667 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:13.628958 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-23ccd9cb-0578-43a0-a634-261d0ccdd667 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: 1f27297a-359e-4f6d-b435-8c0c7ce84163] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:13.635701 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-23ccd9cb-0578-43a0-a634-261d0ccdd667 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:13.636150 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-23ccd9cb-0578-43a0-a634-261d0ccdd667 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:13.636908 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-23ccd9cb-0578-43a0-a634-261d0ccdd667 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:13.637365 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-23ccd9cb-0578-43a0-a634-261d0ccdd667 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:13.768755 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-23ccd9cb-0578-43a0-a634-261d0ccdd667 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:13.780596 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-23ccd9cb-0578-43a0-a634-261d0ccdd667 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163" status: 200 len: 1318 microversion: 2.1 time: 0.158591 Dec 16 15:53:13.781490 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 365/686] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:53:13 2021] GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:53:14.540768 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-5b8d2d87-d15b-4040-b9db-05332192b92c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:14.542125 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-5b8d2d87-d15b-4040-b9db-05332192b92c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:14.551480 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5b8d2d87-d15b-4040-b9db-05332192b92c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:14.552076 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5b8d2d87-d15b-4040-b9db-05332192b92c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:14.553107 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5b8d2d87-d15b-4040-b9db-05332192b92c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:14.553726 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5b8d2d87-d15b-4040-b9db-05332192b92c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:14.641551 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-5b8d2d87-d15b-4040-b9db-05332192b92c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 33981 microversion: 2.20 time: 0.105761 Dec 16 15:53:14.642499 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 322/687] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:53:14 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 33981 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:53:14.801241 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-66aab077-f552-47d7-9772-ac95d6d4de40 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:14.801986 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-66aab077-f552-47d7-9772-ac95d6d4de40 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: 1f27297a-359e-4f6d-b435-8c0c7ce84163] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:14.809713 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-66aab077-f552-47d7-9772-ac95d6d4de40 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:14.810236 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-66aab077-f552-47d7-9772-ac95d6d4de40 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:14.811141 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-66aab077-f552-47d7-9772-ac95d6d4de40 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:14.811644 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-66aab077-f552-47d7-9772-ac95d6d4de40 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:14.954975 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-66aab077-f552-47d7-9772-ac95d6d4de40 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:14.962663 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-66aab077-f552-47d7-9772-ac95d6d4de40 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163" status: 200 len: 1318 microversion: 2.1 time: 0.167336 Dec 16 15:53:14.963232 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 366/688] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:53:14 2021] GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:53:15.656287 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-75c1d948-e74b-4d2d-8aab-1f6ce04d9d18 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:15.657297 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-75c1d948-e74b-4d2d-8aab-1f6ce04d9d18 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:15.664043 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-75c1d948-e74b-4d2d-8aab-1f6ce04d9d18 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:15.664496 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-75c1d948-e74b-4d2d-8aab-1f6ce04d9d18 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:15.665256 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-75c1d948-e74b-4d2d-8aab-1f6ce04d9d18 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:15.665726 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-75c1d948-e74b-4d2d-8aab-1f6ce04d9d18 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:15.745691 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-75c1d948-e74b-4d2d-8aab-1f6ce04d9d18 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 35111 microversion: 2.20 time: 0.093307 Dec 16 15:53:15.746345 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 323/689] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:53:15 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 35111 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:53:15.979531 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-d060a8e9-2bf5-42cd-aed9-fae11557e939 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:15.980147 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-d060a8e9-2bf5-42cd-aed9-fae11557e939 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: 1f27297a-359e-4f6d-b435-8c0c7ce84163] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:15.987012 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d060a8e9-2bf5-42cd-aed9-fae11557e939 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:15.987453 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d060a8e9-2bf5-42cd-aed9-fae11557e939 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:15.988227 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d060a8e9-2bf5-42cd-aed9-fae11557e939 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:15.988653 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d060a8e9-2bf5-42cd-aed9-fae11557e939 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:16.120766 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-d060a8e9-2bf5-42cd-aed9-fae11557e939 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:16.132385 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-d060a8e9-2bf5-42cd-aed9-fae11557e939 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163" status: 200 len: 1318 microversion: 2.1 time: 0.156286 Dec 16 15:53:16.133240 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 367/690] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:53:15 2021] GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:53:16.762949 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-d55dafe8-beaf-42c2-8dca-c19f62a0df28 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:16.764442 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-d55dafe8-beaf-42c2-8dca-c19f62a0df28 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:16.776501 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d55dafe8-beaf-42c2-8dca-c19f62a0df28 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:16.777234 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d55dafe8-beaf-42c2-8dca-c19f62a0df28 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:16.778572 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d55dafe8-beaf-42c2-8dca-c19f62a0df28 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:16.779264 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d55dafe8-beaf-42c2-8dca-c19f62a0df28 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:16.858555 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-d55dafe8-beaf-42c2-8dca-c19f62a0df28 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 35962 microversion: 2.20 time: 0.102098 Dec 16 15:53:16.859538 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 324/691] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:53:16 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 35962 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:53:17.153581 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-8a1d7f26-f72c-4f24-82d2-a0731475a366 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:17.154614 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-8a1d7f26-f72c-4f24-82d2-a0731475a366 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: 1f27297a-359e-4f6d-b435-8c0c7ce84163] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:17.165186 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8a1d7f26-f72c-4f24-82d2-a0731475a366 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:17.165994 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8a1d7f26-f72c-4f24-82d2-a0731475a366 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:17.167267 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8a1d7f26-f72c-4f24-82d2-a0731475a366 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:17.167999 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8a1d7f26-f72c-4f24-82d2-a0731475a366 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:17.316704 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-8a1d7f26-f72c-4f24-82d2-a0731475a366 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:17.324701 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-8a1d7f26-f72c-4f24-82d2-a0731475a366 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163" status: 200 len: 1318 microversion: 2.1 time: 0.177450 Dec 16 15:53:17.325268 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 368/692] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:53:17 2021] GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:53:17.708185 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-a0a3aa64-ae63-4ca6-807d-1dcd71371ae0 req-c1c9853a-1fcc-479c-b3d5-e2c6fda3aa5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f27297a-359e-4f6d-b435-8c0c7ce84163", "name": "network-vif-plugged", "status": "completed", "tag": "97324e88-36de-449c-857f-bc2d3f7a912d"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:17.709841 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:53:17.709841 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:53:17.718927 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-a0a3aa64-ae63-4ca6-807d-1dcd71371ae0 req-c1c9853a-1fcc-479c-b3d5-e2c6fda3aa5b service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:17.719707 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-a0a3aa64-ae63-4ca6-807d-1dcd71371ae0 req-c1c9853a-1fcc-479c-b3d5-e2c6fda3aa5b service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:17.731193 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-a0a3aa64-ae63-4ca6-807d-1dcd71371ae0 req-c1c9853a-1fcc-479c-b3d5-e2c6fda3aa5b service nova] Creating event network-vif-plugged:97324e88-36de-449c-857f-bc2d3f7a912d for instance 1f27297a-359e-4f6d-b435-8c0c7ce84163 on hv-cinder-78447 Dec 16 15:53:17.735911 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-a0a3aa64-ae63-4ca6-807d-1dcd71371ae0 req-c1c9853a-1fcc-479c-b3d5-e2c6fda3aa5b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032179 Dec 16 15:53:17.736709 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 325/693] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:53:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:53:17.873171 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-351227a4-5098-40fe-8e84-b91335e4f4af tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:17.874187 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-351227a4-5098-40fe-8e84-b91335e4f4af tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:17.880571 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-351227a4-5098-40fe-8e84-b91335e4f4af tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:17.881062 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-351227a4-5098-40fe-8e84-b91335e4f4af tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:17.881892 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-351227a4-5098-40fe-8e84-b91335e4f4af tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:17.882324 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-351227a4-5098-40fe-8e84-b91335e4f4af tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:17.960310 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-351227a4-5098-40fe-8e84-b91335e4f4af tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 37161 microversion: 2.20 time: 0.090757 Dec 16 15:53:17.960938 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 369/694] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:53:17 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 37161 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:53:18.347607 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-6ed7b144-418a-4e28-a20a-7a0f210ae26f tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:18.348702 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-6ed7b144-418a-4e28-a20a-7a0f210ae26f tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: 1f27297a-359e-4f6d-b435-8c0c7ce84163] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:18.357088 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6ed7b144-418a-4e28-a20a-7a0f210ae26f tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:18.357561 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6ed7b144-418a-4e28-a20a-7a0f210ae26f tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:18.358460 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6ed7b144-418a-4e28-a20a-7a0f210ae26f tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:18.358898 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6ed7b144-418a-4e28-a20a-7a0f210ae26f tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:18.498631 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-6ed7b144-418a-4e28-a20a-7a0f210ae26f tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:18.506198 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-6ed7b144-418a-4e28-a20a-7a0f210ae26f tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163" status: 200 len: 1318 microversion: 2.1 time: 0.166800 Dec 16 15:53:18.506798 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 326/695] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:53:18 2021] GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:53:18.977874 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-aa8bc9d8-d4a0-4195-8107-fdc41162d295 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:18.979569 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-aa8bc9d8-d4a0-4195-8107-fdc41162d295 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:18.990955 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-aa8bc9d8-d4a0-4195-8107-fdc41162d295 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:18.991694 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-aa8bc9d8-d4a0-4195-8107-fdc41162d295 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:18.992971 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-aa8bc9d8-d4a0-4195-8107-fdc41162d295 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:18.993891 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-aa8bc9d8-d4a0-4195-8107-fdc41162d295 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:19.081226 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-aa8bc9d8-d4a0-4195-8107-fdc41162d295 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 38284 microversion: 2.20 time: 0.110025 Dec 16 15:53:19.082643 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 370/696] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:53:18 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 38284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:53:19.524032 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-e86d7484-17cc-48fa-b209-4746be3d1f85 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:19.524749 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-e86d7484-17cc-48fa-b209-4746be3d1f85 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: 1f27297a-359e-4f6d-b435-8c0c7ce84163] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:19.531894 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e86d7484-17cc-48fa-b209-4746be3d1f85 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:19.532335 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e86d7484-17cc-48fa-b209-4746be3d1f85 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:19.533097 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e86d7484-17cc-48fa-b209-4746be3d1f85 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:19.533633 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e86d7484-17cc-48fa-b209-4746be3d1f85 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:19.668219 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-e86d7484-17cc-48fa-b209-4746be3d1f85 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:19.675610 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-e86d7484-17cc-48fa-b209-4746be3d1f85 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163" status: 200 len: 1507 microversion: 2.1 time: 0.155944 Dec 16 15:53:19.676183 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 327/697] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:53:19 2021] GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:53:20.094428 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-4761b881-300c-43e0-8403-5fd9f66f11d9 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:20.096397 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-4761b881-300c-43e0-8403-5fd9f66f11d9 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:20.104628 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4761b881-300c-43e0-8403-5fd9f66f11d9 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:20.105157 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4761b881-300c-43e0-8403-5fd9f66f11d9 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:20.106032 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4761b881-300c-43e0-8403-5fd9f66f11d9 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:20.106656 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4761b881-300c-43e0-8403-5fd9f66f11d9 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:20.196265 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-4761b881-300c-43e0-8403-5fd9f66f11d9 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 38286 microversion: 2.20 time: 0.106204 Dec 16 15:53:20.198250 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 371/698] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:53:20 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 38286 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:53:21.208973 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-cd191121-0afe-448a-b11e-5f4e73f1f42d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:21.209957 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-cd191121-0afe-448a-b11e-5f4e73f1f42d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:21.216869 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cd191121-0afe-448a-b11e-5f4e73f1f42d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:21.217326 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cd191121-0afe-448a-b11e-5f4e73f1f42d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:21.218141 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cd191121-0afe-448a-b11e-5f4e73f1f42d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:21.218575 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cd191121-0afe-448a-b11e-5f4e73f1f42d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:21.303120 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-cd191121-0afe-448a-b11e-5f4e73f1f42d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 38286 microversion: 2.20 time: 0.097761 Dec 16 15:53:21.303784 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 328/699] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:53:21 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 38286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:53:22.318546 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-d16d4b1c-a7fe-4b3a-8852-c0ae759492df tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:22.319725 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-d16d4b1c-a7fe-4b3a-8852-c0ae759492df tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:22.328110 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d16d4b1c-a7fe-4b3a-8852-c0ae759492df tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:22.328554 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d16d4b1c-a7fe-4b3a-8852-c0ae759492df tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:22.329333 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d16d4b1c-a7fe-4b3a-8852-c0ae759492df tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:22.329827 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d16d4b1c-a7fe-4b3a-8852-c0ae759492df tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:22.417839 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-d16d4b1c-a7fe-4b3a-8852-c0ae759492df tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 200 len: 38426 microversion: 2.20 time: 0.104740 Dec 16 15:53:22.418515 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 372/700] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:53:22 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 38426 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:53:22.429363 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-e2ec0ff9-86bb-4b73-b59a-a50a04e8739d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:22.429988 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-e2ec0ff9-86bb-4b73-b59a-a50a04e8739d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:22.437919 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e2ec0ff9-86bb-4b73-b59a-a50a04e8739d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:22.438361 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e2ec0ff9-86bb-4b73-b59a-a50a04e8739d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:22.439147 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e2ec0ff9-86bb-4b73-b59a-a50a04e8739d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:22.439594 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e2ec0ff9-86bb-4b73-b59a-a50a04e8739d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:22.468584 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-e2ec0ff9-86bb-4b73-b59a-a50a04e8739d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/ips" status: 200 len: 153 microversion: 2.20 time: 0.043558 Dec 16 15:53:22.469145 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 329/701] 10.222.0.31 () {60 vars in 1288 bytes} [Thu Dec 16 15:53:22 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/ips => generated 153 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:53:24.719996 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-c9e76947-d754-4c99-80df-2e1fc3bc4231 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:24.720574 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-c9e76947-d754-4c99-80df-2e1fc3bc4231 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:24.728205 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c9e76947-d754-4c99-80df-2e1fc3bc4231 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:24.728647 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c9e76947-d754-4c99-80df-2e1fc3bc4231 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:24.729454 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c9e76947-d754-4c99-80df-2e1fc3bc4231 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:24.729864 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c9e76947-d754-4c99-80df-2e1fc3bc4231 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:24.753862 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.objects.instance [None req-c9e76947-d754-4c99-80df-2e1fc3bc4231 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lazy-loading 'flavor' on Instance uuid 635ee3bb-dc82-4d25-95fc-ef55d01f0705 {{(pid=122399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:53:25.017839 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-c9e76947-d754-4c99-80df-2e1fc3bc4231 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 202 len: 0 microversion: 2.20 time: 0.302704 Dec 16 15:53:25.018530 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 373/702] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:53:24 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:53:25.026936 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-006af067-1ea1-44e8-971c-9c13369158f3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:25.027553 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-006af067-1ea1-44e8-971c-9c13369158f3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:25.034706 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-006af067-1ea1-44e8-971c-9c13369158f3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:25.035169 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-006af067-1ea1-44e8-971c-9c13369158f3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:25.036015 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-006af067-1ea1-44e8-971c-9c13369158f3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:25.036546 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-006af067-1ea1-44e8-971c-9c13369158f3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:25.175978 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-006af067-1ea1-44e8-971c-9c13369158f3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:25.187113 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-006af067-1ea1-44e8-971c-9c13369158f3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:25.189467 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-006af067-1ea1-44e8-971c-9c13369158f3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:25.191213 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-006af067-1ea1-44e8-971c-9c13369158f3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1725 microversion: 2.20 time: 0.167808 Dec 16 15:53:25.192074 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 330/703] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:53:25 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:53:26.213672 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-2ae75688-52f9-413f-be6b-ef44548a3004 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:26.214576 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-2ae75688-52f9-413f-be6b-ef44548a3004 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:26.222761 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2ae75688-52f9-413f-be6b-ef44548a3004 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:26.223213 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2ae75688-52f9-413f-be6b-ef44548a3004 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:26.223996 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2ae75688-52f9-413f-be6b-ef44548a3004 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:26.224410 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2ae75688-52f9-413f-be6b-ef44548a3004 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:26.362616 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-2ae75688-52f9-413f-be6b-ef44548a3004 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:26.371134 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-2ae75688-52f9-413f-be6b-ef44548a3004 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:26.372617 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-2ae75688-52f9-413f-be6b-ef44548a3004 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:26.373853 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-2ae75688-52f9-413f-be6b-ef44548a3004 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1725 microversion: 2.20 time: 0.166247 Dec 16 15:53:26.385045 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 374/704] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:53:26 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:53:27.394147 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-02d53ae2-3c09-4d02-ba01-998533eed3f7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:27.394974 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-02d53ae2-3c09-4d02-ba01-998533eed3f7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:27.404257 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-02d53ae2-3c09-4d02-ba01-998533eed3f7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:27.404892 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-02d53ae2-3c09-4d02-ba01-998533eed3f7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:27.406021 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-02d53ae2-3c09-4d02-ba01-998533eed3f7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:27.406667 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-02d53ae2-3c09-4d02-ba01-998533eed3f7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:27.548086 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-02d53ae2-3c09-4d02-ba01-998533eed3f7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:27.559777 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-02d53ae2-3c09-4d02-ba01-998533eed3f7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:27.562127 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-02d53ae2-3c09-4d02-ba01-998533eed3f7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:27.563688 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-02d53ae2-3c09-4d02-ba01-998533eed3f7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1725 microversion: 2.20 time: 0.174472 Dec 16 15:53:27.564218 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 331/705] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:53:27 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:53:28.580852 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-5692527e-8683-4153-a20b-170ddb1bdb27 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:28.581480 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-5692527e-8683-4153-a20b-170ddb1bdb27 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:28.588258 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5692527e-8683-4153-a20b-170ddb1bdb27 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:28.588712 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5692527e-8683-4153-a20b-170ddb1bdb27 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:28.589515 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5692527e-8683-4153-a20b-170ddb1bdb27 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:28.589942 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5692527e-8683-4153-a20b-170ddb1bdb27 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:28.725121 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-5692527e-8683-4153-a20b-170ddb1bdb27 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:28.733602 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-5692527e-8683-4153-a20b-170ddb1bdb27 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:28.735023 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-5692527e-8683-4153-a20b-170ddb1bdb27 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:28.736238 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-5692527e-8683-4153-a20b-170ddb1bdb27 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1725 microversion: 2.20 time: 0.159152 Dec 16 15:53:28.736799 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 375/706] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:53:28 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:53:29.754749 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-6fce2177-686c-4ec3-b484-ced901809c05 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:29.755323 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-6fce2177-686c-4ec3-b484-ced901809c05 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:29.761951 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6fce2177-686c-4ec3-b484-ced901809c05 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:29.762398 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6fce2177-686c-4ec3-b484-ced901809c05 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:29.763158 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6fce2177-686c-4ec3-b484-ced901809c05 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:29.763580 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6fce2177-686c-4ec3-b484-ced901809c05 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:29.896387 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-6fce2177-686c-4ec3-b484-ced901809c05 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:29.905072 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-6fce2177-686c-4ec3-b484-ced901809c05 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:29.906587 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-6fce2177-686c-4ec3-b484-ced901809c05 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:29.907763 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-6fce2177-686c-4ec3-b484-ced901809c05 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1725 microversion: 2.20 time: 0.157021 Dec 16 15:53:29.908332 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 332/707] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:53:29 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:53:30.926357 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-c4f9b6b6-75f0-448e-a00c-fd1253f5db7e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:30.927045 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-c4f9b6b6-75f0-448e-a00c-fd1253f5db7e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:30.933850 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c4f9b6b6-75f0-448e-a00c-fd1253f5db7e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:30.934297 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c4f9b6b6-75f0-448e-a00c-fd1253f5db7e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:30.935077 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c4f9b6b6-75f0-448e-a00c-fd1253f5db7e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:30.935504 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c4f9b6b6-75f0-448e-a00c-fd1253f5db7e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:31.072196 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-c4f9b6b6-75f0-448e-a00c-fd1253f5db7e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:31.080328 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-c4f9b6b6-75f0-448e-a00c-fd1253f5db7e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:31.081966 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-c4f9b6b6-75f0-448e-a00c-fd1253f5db7e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:31.083134 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-c4f9b6b6-75f0-448e-a00c-fd1253f5db7e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1725 microversion: 2.20 time: 0.160553 Dec 16 15:53:31.083809 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 376/708] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:53:30 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:53:31.627529 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-a296fa9a-ccc9-40c6-83ac-6ea183c3cbfc tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:31.628502 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-a296fa9a-ccc9-40c6-83ac-6ea183c3cbfc tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:31.635105 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a296fa9a-ccc9-40c6-83ac-6ea183c3cbfc tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:31.635548 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a296fa9a-ccc9-40c6-83ac-6ea183c3cbfc tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:31.636314 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a296fa9a-ccc9-40c6-83ac-6ea183c3cbfc tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:31.636738 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a296fa9a-ccc9-40c6-83ac-6ea183c3cbfc tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:31.666709 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-a296fa9a-ccc9-40c6-83ac-6ea183c3cbfc tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042914 Dec 16 15:53:31.667454 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 333/709] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Dec 16 15:53:31 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:53:31.725934 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-4642eb75-1a3a-47fe-986d-b22bb0aa3f02 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:31.726434 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-4642eb75-1a3a-47fe-986d-b22bb0aa3f02 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:31.732762 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4642eb75-1a3a-47fe-986d-b22bb0aa3f02 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:31.733214 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4642eb75-1a3a-47fe-986d-b22bb0aa3f02 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:31.734047 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4642eb75-1a3a-47fe-986d-b22bb0aa3f02 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:31.734482 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4642eb75-1a3a-47fe-986d-b22bb0aa3f02 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:31.759013 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-4642eb75-1a3a-47fe-986d-b22bb0aa3f02 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Going to try to terminate instance {{(pid=122399) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 15:53:31.842597 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-4642eb75-1a3a-47fe-986d-b22bb0aa3f02 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "DELETE /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 204 len: 0 microversion: 2.1 time: 0.120300 Dec 16 15:53:31.843195 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 377/710] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Dec 16 15:53:31 2021] DELETE /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:53:31.852869 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-3128f456-9e59-4570-8075-647927a0ac6a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:31.853514 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-3128f456-9e59-4570-8075-647927a0ac6a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:31.859384 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3128f456-9e59-4570-8075-647927a0ac6a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:31.859833 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3128f456-9e59-4570-8075-647927a0ac6a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:31.860605 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3128f456-9e59-4570-8075-647927a0ac6a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:31.861037 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3128f456-9e59-4570-8075-647927a0ac6a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:31.997164 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-3128f456-9e59-4570-8075-647927a0ac6a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:32.005064 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-3128f456-9e59-4570-8075-647927a0ac6a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1671 microversion: 2.1 time: 0.156808 Dec 16 15:53:32.005892 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 334/711] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:53:31 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:53:32.102812 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-fcdc8b98-50b0-4a5f-9a2c-d37f9232b4d5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:32.103505 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-fcdc8b98-50b0-4a5f-9a2c-d37f9232b4d5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:32.110239 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-fcdc8b98-50b0-4a5f-9a2c-d37f9232b4d5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:32.110686 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-fcdc8b98-50b0-4a5f-9a2c-d37f9232b4d5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:32.111459 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-fcdc8b98-50b0-4a5f-9a2c-d37f9232b4d5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:32.111890 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-fcdc8b98-50b0-4a5f-9a2c-d37f9232b4d5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:32.246432 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-fcdc8b98-50b0-4a5f-9a2c-d37f9232b4d5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:32.254211 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-fcdc8b98-50b0-4a5f-9a2c-d37f9232b4d5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:32.255735 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-fcdc8b98-50b0-4a5f-9a2c-d37f9232b4d5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:32.256894 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-fcdc8b98-50b0-4a5f-9a2c-d37f9232b4d5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1725 microversion: 2.20 time: 0.158286 Dec 16 15:53:32.257459 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 378/712] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:53:32 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:53:33.024305 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-fad89e2f-8e73-4c3d-87ed-abb259be1d90 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:33.024871 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-fad89e2f-8e73-4c3d-87ed-abb259be1d90 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:33.032284 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-fad89e2f-8e73-4c3d-87ed-abb259be1d90 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:33.032731 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-fad89e2f-8e73-4c3d-87ed-abb259be1d90 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:33.033609 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-fad89e2f-8e73-4c3d-87ed-abb259be1d90 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:33.034058 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-fad89e2f-8e73-4c3d-87ed-abb259be1d90 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:33.167821 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-fad89e2f-8e73-4c3d-87ed-abb259be1d90 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:33.175720 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-fad89e2f-8e73-4c3d-87ed-abb259be1d90 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1671 microversion: 2.1 time: 0.155739 Dec 16 15:53:33.176287 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 335/713] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:53:33 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:53:33.275099 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-303d7255-0dc0-4496-9bef-e162b8e30577 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:33.275678 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-303d7255-0dc0-4496-9bef-e162b8e30577 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:33.282295 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-303d7255-0dc0-4496-9bef-e162b8e30577 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:33.282748 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-303d7255-0dc0-4496-9bef-e162b8e30577 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:33.283524 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-303d7255-0dc0-4496-9bef-e162b8e30577 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:33.283959 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-303d7255-0dc0-4496-9bef-e162b8e30577 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:33.427486 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-303d7255-0dc0-4496-9bef-e162b8e30577 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:33.439506 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-303d7255-0dc0-4496-9bef-e162b8e30577 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:33.441805 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-303d7255-0dc0-4496-9bef-e162b8e30577 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:33.443282 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-303d7255-0dc0-4496-9bef-e162b8e30577 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1725 microversion: 2.20 time: 0.172004 Dec 16 15:53:33.443820 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 379/714] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:53:33 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:53:34.192248 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-573b0187-5bc0-480c-ac7e-0da442af7a9c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:34.192811 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-573b0187-5bc0-480c-ac7e-0da442af7a9c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:34.199538 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-573b0187-5bc0-480c-ac7e-0da442af7a9c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:34.199982 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-573b0187-5bc0-480c-ac7e-0da442af7a9c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:34.200755 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-573b0187-5bc0-480c-ac7e-0da442af7a9c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:34.201184 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-573b0187-5bc0-480c-ac7e-0da442af7a9c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:34.405951 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-573b0187-5bc0-480c-ac7e-0da442af7a9c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:34.413842 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-573b0187-5bc0-480c-ac7e-0da442af7a9c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1671 microversion: 2.1 time: 0.225422 Dec 16 15:53:34.414445 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 336/715] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:53:34 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1671 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:53:34.461987 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-5fbe26fd-b0c8-4f8d-8924-32715082805a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:34.462547 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-5fbe26fd-b0c8-4f8d-8924-32715082805a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:34.469143 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5fbe26fd-b0c8-4f8d-8924-32715082805a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:34.469617 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5fbe26fd-b0c8-4f8d-8924-32715082805a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:34.470383 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5fbe26fd-b0c8-4f8d-8924-32715082805a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:34.470803 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5fbe26fd-b0c8-4f8d-8924-32715082805a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:35.004010 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-5fbe26fd-b0c8-4f8d-8924-32715082805a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:35.012738 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-5fbe26fd-b0c8-4f8d-8924-32715082805a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:35.014324 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-5fbe26fd-b0c8-4f8d-8924-32715082805a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:35.015505 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-5fbe26fd-b0c8-4f8d-8924-32715082805a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1725 microversion: 2.20 time: 0.557276 Dec 16 15:53:35.016059 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 380/716] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:53:34 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1725 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:53:35.431258 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-f4cbbb9b-122a-442d-a7f5-514c06aee246 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:35.431844 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-f4cbbb9b-122a-442d-a7f5-514c06aee246 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:35.438666 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f4cbbb9b-122a-442d-a7f5-514c06aee246 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:35.439136 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f4cbbb9b-122a-442d-a7f5-514c06aee246 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:35.439922 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f4cbbb9b-122a-442d-a7f5-514c06aee246 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:35.440328 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f4cbbb9b-122a-442d-a7f5-514c06aee246 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:35.539657 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-d1f193a0-2c40-4578-9ecf-4dac8c720bd3 req-880ebc25-7a8d-4969-af24-85991a16a1b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29bba044-2e01-44b1-bb03-0f367846a5f0", "name": "network-vif-deleted", "tag": "1b9973de-48e3-4cb5-a15d-7bd646981f14"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:35.541888 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:53:35.541888 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:53:35.550677 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-d1f193a0-2c40-4578-9ecf-4dac8c720bd3 req-880ebc25-7a8d-4969-af24-85991a16a1b2 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:35.551887 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-d1f193a0-2c40-4578-9ecf-4dac8c720bd3 req-880ebc25-7a8d-4969-af24-85991a16a1b2 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:35.554746 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-f4cbbb9b-122a-442d-a7f5-514c06aee246 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:35.563367 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-f4cbbb9b-122a-442d-a7f5-514c06aee246 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 200 len: 1604 microversion: 2.1 time: 0.135859 Dec 16 15:53:35.564279 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 337/717] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:53:35 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 1604 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:53:35.571753 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-d1f193a0-2c40-4578-9ecf-4dac8c720bd3 req-880ebc25-7a8d-4969-af24-85991a16a1b2 service nova] Creating event network-vif-deleted:1b9973de-48e3-4cb5-a15d-7bd646981f14 for instance 29bba044-2e01-44b1-bb03-0f367846a5f0 on hv-cinder-78447 Dec 16 15:53:35.577018 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-d1f193a0-2c40-4578-9ecf-4dac8c720bd3 req-880ebc25-7a8d-4969-af24-85991a16a1b2 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044315 Dec 16 15:53:35.577846 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 381/718] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:53:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:53:36.033806 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-a9678121-461e-46e7-a51e-8f3de263c19d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:36.034448 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-a9678121-461e-46e7-a51e-8f3de263c19d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:36.041483 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a9678121-461e-46e7-a51e-8f3de263c19d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:36.041933 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a9678121-461e-46e7-a51e-8f3de263c19d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:36.042713 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a9678121-461e-46e7-a51e-8f3de263c19d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:36.043132 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a9678121-461e-46e7-a51e-8f3de263c19d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:36.227286 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-a9678121-461e-46e7-a51e-8f3de263c19d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:36.236150 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-a9678121-461e-46e7-a51e-8f3de263c19d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:36.237941 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-a9678121-461e-46e7-a51e-8f3de263c19d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:36.239593 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-a9678121-461e-46e7-a51e-8f3de263c19d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1725 microversion: 2.20 time: 0.209607 Dec 16 15:53:36.240155 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 338/719] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:53:36 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1725 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:53:36.581301 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-67f5321d-3c23-4c4c-9773-ba7a5a4a49e5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:36.582224 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-67f5321d-3c23-4c4c-9773-ba7a5a4a49e5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:36.588989 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-67f5321d-3c23-4c4c-9773-ba7a5a4a49e5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:36.589442 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-67f5321d-3c23-4c4c-9773-ba7a5a4a49e5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:36.590236 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-67f5321d-3c23-4c4c-9773-ba7a5a4a49e5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:36.591012 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-67f5321d-3c23-4c4c-9773-ba7a5a4a49e5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:36.604820 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.wsgi [None req-67f5321d-3c23-4c4c-9773-ba7a5a4a49e5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] HTTP exception thrown: Instance 29bba044-2e01-44b1-bb03-0f367846a5f0 could not be found. Dec 16 15:53:36.605633 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-67f5321d-3c23-4c4c-9773-ba7a5a4a49e5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Returning 404 to user: Instance 29bba044-2e01-44b1-bb03-0f367846a5f0 could not be found. {{(pid=122399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:53:36.606489 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-67f5321d-3c23-4c4c-9773-ba7a5a4a49e5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 404 len: 111 microversion: 2.1 time: 0.029341 Dec 16 15:53:36.607051 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 382/720] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:53:36 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:53:36.615673 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-d0f34ac6-cea8-4250-8875-8dee8ef20890 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '.version_select at 0x7fed5dff00d0>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:36.640319 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-d0f34ac6-cea8-4250-8875-8dee8ef20890 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-93241437" status: 202 len: 0 microversion: 2.1 time: 0.028336 Dec 16 15:53:36.640947 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 339/721] 10.222.0.31 () {58 vars in 1214 bytes} [Thu Dec 16 15:53:36 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-93241437 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:53:37.257878 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-df3f1e62-9ad1-4715-a5da-e7084e6a89fb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:37.258475 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-df3f1e62-9ad1-4715-a5da-e7084e6a89fb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:37.264121 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-df3f1e62-9ad1-4715-a5da-e7084e6a89fb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:37.265154 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-df3f1e62-9ad1-4715-a5da-e7084e6a89fb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:37.266040 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-df3f1e62-9ad1-4715-a5da-e7084e6a89fb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:37.266482 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-df3f1e62-9ad1-4715-a5da-e7084e6a89fb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:37.319353 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-2b3b1ada-57df-4aa4-8a4c-c52863184945 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'create', calling method: .version_select at 0x7fed5deb23a0>, body: {"keypair": {"name": "tempest-keypair-1053941765"}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:37.334469 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.quota [None req-2b3b1ada-57df-4aa4-8a4c-c52863184945 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Getting quotas for project a82af4eab10342ddbdddd09e11579c36. Resources: {'key_pairs'} {{(pid=122398) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:53:37.338475 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.quota [None req-2b3b1ada-57df-4aa4-8a4c-c52863184945 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Getting quotas for user 922251edc0754769985fdb8be76f5984 and project a82af4eab10342ddbdddd09e11579c36. Resources: {'key_pairs'} {{(pid=122398) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:53:37.407505 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-df3f1e62-9ad1-4715-a5da-e7084e6a89fb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:37.415629 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-df3f1e62-9ad1-4715-a5da-e7084e6a89fb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:37.417090 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-df3f1e62-9ad1-4715-a5da-e7084e6a89fb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:37.418297 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-df3f1e62-9ad1-4715-a5da-e7084e6a89fb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1725 microversion: 2.20 time: 0.164228 Dec 16 15:53:37.419040 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 383/722] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:53:37 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:53:37.619485 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.quota [None req-2b3b1ada-57df-4aa4-8a4c-c52863184945 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Getting quotas for project a82af4eab10342ddbdddd09e11579c36. Resources: {'key_pairs'} {{(pid=122398) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:53:37.624129 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.quota [None req-2b3b1ada-57df-4aa4-8a4c-c52863184945 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Getting quotas for user 922251edc0754769985fdb8be76f5984 and project a82af4eab10342ddbdddd09e11579c36. Resources: {'key_pairs'} {{(pid=122398) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:53:37.638861 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-2b3b1ada-57df-4aa4-8a4c-c52863184945 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.323344 Dec 16 15:53:37.639435 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 340/723] 10.222.0.31 () {60 vars in 1157 bytes} [Thu Dec 16 15:53:37 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:53:37.993208 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-b80a293b-42e4-4300-b434-1f94b634d5d1 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e500c9e8-9dc7-4e68-b882-bf553cd83401", "device": "/dev/sdb"}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:37.994816 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-b80a293b-42e4-4300-b434-1f94b634d5d1 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: 1f27297a-359e-4f6d-b435-8c0c7ce84163] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:38.001495 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b80a293b-42e4-4300-b434-1f94b634d5d1 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:38.001955 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b80a293b-42e4-4300-b434-1f94b634d5d1 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:38.002776 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b80a293b-42e4-4300-b434-1f94b634d5d1 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:38.003212 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b80a293b-42e4-4300-b434-1f94b634d5d1 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:38.390331 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-b80a293b-42e4-4300-b434-1f94b634d5d1 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "POST /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.401618 Dec 16 15:53:38.390931 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 384/724] 10.222.0.31 () {60 vars in 1322 bytes} [Thu Dec 16 15:53:37 2021] POST /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163/os-volume_attachments => generated 194 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:53:38.435936 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-21245a04-7b7f-47e9-89e0-68c2369b069f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:38.445748 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-21245a04-7b7f-47e9-89e0-68c2369b069f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:38.451806 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-21245a04-7b7f-47e9-89e0-68c2369b069f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:38.452254 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-21245a04-7b7f-47e9-89e0-68c2369b069f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:38.453039 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-21245a04-7b7f-47e9-89e0-68c2369b069f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:38.453492 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-21245a04-7b7f-47e9-89e0-68c2369b069f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:38.604780 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-21245a04-7b7f-47e9-89e0-68c2369b069f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:38.612985 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-21245a04-7b7f-47e9-89e0-68c2369b069f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:38.615288 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-21245a04-7b7f-47e9-89e0-68c2369b069f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:38.616734 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-21245a04-7b7f-47e9-89e0-68c2369b069f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1725 microversion: 2.20 time: 0.184634 Dec 16 15:53:38.617629 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 341/725] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:53:38 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:53:38.936378 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-343059c8-6838-4558-8960-3139ad145238 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1772577430", "imageRef": "2a1434ad-0c2c-4725-baad-a605624baf01", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "995ae86b-522a-475e-97b2-0044dee2628f"}], "security_groups": [{"name": "tempest-securitygroup--1180816757"}], "key_name": "tempest-keypair-1053941765", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:39.048644 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.network.neutron [None req-343059c8-6838-4558-8960-3139ad145238 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] validate_networks() for [('995ae86b-522a-475e-97b2-0044dee2628f', None, None, None, None, None)] {{(pid=122399) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 15:53:39.431224 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-343059c8-6838-4558-8960-3139ad145238 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Flavor limits 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 15:53:39.431812 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-343059c8-6838-4558-8960-3139ad145238 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Image limits 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 15:53:39.432522 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-343059c8-6838-4558-8960-3139ad145238 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Flavor pref 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 15:53:39.433114 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-343059c8-6838-4558-8960-3139ad145238 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Image pref 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 15:53:39.433733 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-343059c8-6838-4558-8960-3139ad145238 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 15:53:39.445247 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-343059c8-6838-4558-8960-3139ad145238 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:39.445741 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-343059c8-6838-4558-8960-3139ad145238 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:39.446550 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-343059c8-6838-4558-8960-3139ad145238 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:39.447300 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-343059c8-6838-4558-8960-3139ad145238 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:39.463257 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-343059c8-6838-4558-8960-3139ad145238 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Getting quotas for project a82af4eab10342ddbdddd09e11579c36. Resources: {'instances', 'ram', 'cores'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:53:39.467248 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-343059c8-6838-4558-8960-3139ad145238 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Getting quotas for user 922251edc0754769985fdb8be76f5984 and project a82af4eab10342ddbdddd09e11579c36. Resources: {'instances', 'ram', 'cores'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:53:39.482510 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-343059c8-6838-4558-8960-3139ad145238 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Going to run 1 instances... {{(pid=122399) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 15:53:39.482510 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-343059c8-6838-4558-8960-3139ad145238 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a1434ad-0c2c-4725-baad-a605624baf01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 15:53:39.531678 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-343059c8-6838-4558-8960-3139ad145238 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.600145 Dec 16 15:53:39.532322 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 385/726] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Dec 16 15:53:38 2021] POST /compute/v2.1/servers => generated 402 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 15:53:39.542268 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-69141cd5-9ceb-4e79-8e7f-07cb31688615 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:39.542852 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-69141cd5-9ceb-4e79-8e7f-07cb31688615 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:39.635159 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-e4921752-0f26-4ad9-8b5d-909bf8983abf tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:39.635859 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-e4921752-0f26-4ad9-8b5d-909bf8983abf tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:39.645335 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e4921752-0f26-4ad9-8b5d-909bf8983abf tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:39.646157 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e4921752-0f26-4ad9-8b5d-909bf8983abf tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:39.647101 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e4921752-0f26-4ad9-8b5d-909bf8983abf tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:39.647810 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e4921752-0f26-4ad9-8b5d-909bf8983abf tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:39.651974 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-69141cd5-9ceb-4e79-8e7f-07cb31688615 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:39.658978 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-69141cd5-9ceb-4e79-8e7f-07cb31688615 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1" status: 200 len: 1238 microversion: 2.1 time: 0.120429 Dec 16 15:53:39.659542 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 342/727] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:53:39 2021] GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1 => generated 1238 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:53:39.783643 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-e4921752-0f26-4ad9-8b5d-909bf8983abf tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:39.791991 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-e4921752-0f26-4ad9-8b5d-909bf8983abf tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:39.793505 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-e4921752-0f26-4ad9-8b5d-909bf8983abf tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:39.794670 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-e4921752-0f26-4ad9-8b5d-909bf8983abf tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1725 microversion: 2.20 time: 0.163413 Dec 16 15:53:39.795226 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 386/728] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:53:39 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:53:40.676354 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-b8f671c8-f861-4248-b36f-13c1bf65425d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:40.677044 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-b8f671c8-f861-4248-b36f-13c1bf65425d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:40.685899 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b8f671c8-f861-4248-b36f-13c1bf65425d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:40.686344 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b8f671c8-f861-4248-b36f-13c1bf65425d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:40.687133 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b8f671c8-f861-4248-b36f-13c1bf65425d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:40.687553 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b8f671c8-f861-4248-b36f-13c1bf65425d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:40.763705 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-b8f671c8-f861-4248-b36f-13c1bf65425d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:40.771342 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-b8f671c8-f861-4248-b36f-13c1bf65425d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1" status: 200 len: 1296 microversion: 2.1 time: 0.099167 Dec 16 15:53:40.772154 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 343/729] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:53:40 2021] GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1 => generated 1296 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:53:40.812945 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-08adc3b3-a7c2-49d0-9bcd-f8ef2102599f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:40.813644 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-08adc3b3-a7c2-49d0-9bcd-f8ef2102599f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:40.821319 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-08adc3b3-a7c2-49d0-9bcd-f8ef2102599f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:40.821798 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-08adc3b3-a7c2-49d0-9bcd-f8ef2102599f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:40.822574 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-08adc3b3-a7c2-49d0-9bcd-f8ef2102599f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:40.823001 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-08adc3b3-a7c2-49d0-9bcd-f8ef2102599f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:41.061881 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-08adc3b3-a7c2-49d0-9bcd-f8ef2102599f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:41.070749 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-08adc3b3-a7c2-49d0-9bcd-f8ef2102599f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:41.072218 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-08adc3b3-a7c2-49d0-9bcd-f8ef2102599f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:41.073370 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-08adc3b3-a7c2-49d0-9bcd-f8ef2102599f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1746 microversion: 2.20 time: 0.264224 Dec 16 15:53:41.073969 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 387/730] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:53:40 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1746 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:53:41.787990 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-b99d6c2e-3a19-4983-9335-343fda07c2e1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:41.789377 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-b99d6c2e-3a19-4983-9335-343fda07c2e1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:41.796134 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b99d6c2e-3a19-4983-9335-343fda07c2e1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:41.796642 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b99d6c2e-3a19-4983-9335-343fda07c2e1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:41.797530 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b99d6c2e-3a19-4983-9335-343fda07c2e1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:41.798032 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b99d6c2e-3a19-4983-9335-343fda07c2e1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:41.986693 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-09f6ab70-0406-4752-8a39-1509cdf0ee48 req-754df0ad-2435-4d5d-8743-77f5fa35ced0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a13b434-9d4a-4c31-80e7-96e6d17580f1", "tag": "9f9dc2a3-5ad0-4f17-8e45-49ed4219d918"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:41.988149 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:53:41.988149 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:53:41.995998 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-09f6ab70-0406-4752-8a39-1509cdf0ee48 req-754df0ad-2435-4d5d-8743-77f5fa35ced0 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:41.996686 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-09f6ab70-0406-4752-8a39-1509cdf0ee48 req-754df0ad-2435-4d5d-8743-77f5fa35ced0 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:42.010451 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-09f6ab70-0406-4752-8a39-1509cdf0ee48 req-754df0ad-2435-4d5d-8743-77f5fa35ced0 service nova] Creating event network-changed:9f9dc2a3-5ad0-4f17-8e45-49ed4219d918 for instance 2a13b434-9d4a-4c31-80e7-96e6d17580f1 on hv-cinder-78447 Dec 16 15:53:42.015257 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-09f6ab70-0406-4752-8a39-1509cdf0ee48 req-754df0ad-2435-4d5d-8743-77f5fa35ced0 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032271 Dec 16 15:53:42.016141 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 388/731] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:53:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:53:42.075251 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-b99d6c2e-3a19-4983-9335-343fda07c2e1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:42.084794 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-b99d6c2e-3a19-4983-9335-343fda07c2e1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1" status: 200 len: 1364 microversion: 2.1 time: 0.300153 Dec 16 15:53:42.086218 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 344/732] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:53:41 2021] GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1 => generated 1364 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:53:42.091559 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-23cabad5-eff8-4ae5-a94d-1122d97585cb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:42.092194 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-23cabad5-eff8-4ae5-a94d-1122d97585cb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:42.099277 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-23cabad5-eff8-4ae5-a94d-1122d97585cb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:42.099831 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-23cabad5-eff8-4ae5-a94d-1122d97585cb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:42.100600 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-23cabad5-eff8-4ae5-a94d-1122d97585cb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:42.101030 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-23cabad5-eff8-4ae5-a94d-1122d97585cb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:42.303376 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-23cabad5-eff8-4ae5-a94d-1122d97585cb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:42.311741 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-23cabad5-eff8-4ae5-a94d-1122d97585cb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:42.313186 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-23cabad5-eff8-4ae5-a94d-1122d97585cb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:42.314402 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-23cabad5-eff8-4ae5-a94d-1122d97585cb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1746 microversion: 2.20 time: 0.227070 Dec 16 15:53:42.314958 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 389/733] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:53:42 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1746 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:53:43.103419 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-d57ea4d5-6431-42eb-8ccd-9ca0577cb2c9 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:43.103981 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-d57ea4d5-6431-42eb-8ccd-9ca0577cb2c9 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:43.110866 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d57ea4d5-6431-42eb-8ccd-9ca0577cb2c9 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:43.111319 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d57ea4d5-6431-42eb-8ccd-9ca0577cb2c9 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:43.112096 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d57ea4d5-6431-42eb-8ccd-9ca0577cb2c9 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:43.112530 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d57ea4d5-6431-42eb-8ccd-9ca0577cb2c9 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:43.260880 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-d57ea4d5-6431-42eb-8ccd-9ca0577cb2c9 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:43.271928 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-d57ea4d5-6431-42eb-8ccd-9ca0577cb2c9 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1" status: 200 len: 1364 microversion: 2.1 time: 0.172412 Dec 16 15:53:43.273206 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 345/734] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:53:43 2021] GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:53:43.332190 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-987be79d-c195-40eb-b572-b49382a39c83 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:43.332805 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-987be79d-c195-40eb-b572-b49382a39c83 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:43.339834 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-987be79d-c195-40eb-b572-b49382a39c83 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:43.340285 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-987be79d-c195-40eb-b572-b49382a39c83 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:43.341083 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-987be79d-c195-40eb-b572-b49382a39c83 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:43.341608 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-987be79d-c195-40eb-b572-b49382a39c83 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:43.475863 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-987be79d-c195-40eb-b572-b49382a39c83 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:43.484123 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-987be79d-c195-40eb-b572-b49382a39c83 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:43.486137 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-987be79d-c195-40eb-b572-b49382a39c83 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:43.487597 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-987be79d-c195-40eb-b572-b49382a39c83 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1741 microversion: 2.20 time: 0.159214 Dec 16 15:53:43.488149 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 390/735] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:53:43 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1741 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:53:44.294804 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-42fec090-2306-42e2-9e16-979cbdc5a5ac tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:44.295407 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-42fec090-2306-42e2-9e16-979cbdc5a5ac tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:44.302466 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-42fec090-2306-42e2-9e16-979cbdc5a5ac tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:44.303163 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-42fec090-2306-42e2-9e16-979cbdc5a5ac tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:44.304194 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-42fec090-2306-42e2-9e16-979cbdc5a5ac tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:44.304798 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-42fec090-2306-42e2-9e16-979cbdc5a5ac tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:44.443259 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-42fec090-2306-42e2-9e16-979cbdc5a5ac tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:44.453292 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-42fec090-2306-42e2-9e16-979cbdc5a5ac tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1" status: 200 len: 1364 microversion: 2.1 time: 0.162050 Dec 16 15:53:44.454436 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 346/736] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:53:44 2021] GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:53:44.511912 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-32c1e60d-bba9-4a00-8151-6ddcbf5b13d8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:44.512530 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-32c1e60d-bba9-4a00-8151-6ddcbf5b13d8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:44.534773 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-32c1e60d-bba9-4a00-8151-6ddcbf5b13d8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:44.537717 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-32c1e60d-bba9-4a00-8151-6ddcbf5b13d8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:44.540027 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-32c1e60d-bba9-4a00-8151-6ddcbf5b13d8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:44.540497 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-32c1e60d-bba9-4a00-8151-6ddcbf5b13d8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:44.697020 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-32c1e60d-bba9-4a00-8151-6ddcbf5b13d8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:44.705500 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-32c1e60d-bba9-4a00-8151-6ddcbf5b13d8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:44.707052 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-32c1e60d-bba9-4a00-8151-6ddcbf5b13d8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:44.708265 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-32c1e60d-bba9-4a00-8151-6ddcbf5b13d8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1741 microversion: 2.20 time: 0.205390 Dec 16 15:53:44.713439 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 391/737] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:53:44 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1741 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:53:45.472919 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-ea3925fc-a312-45a3-8bdd-bad164a7ce7c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:45.473670 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-ea3925fc-a312-45a3-8bdd-bad164a7ce7c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:45.483937 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ea3925fc-a312-45a3-8bdd-bad164a7ce7c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:45.484498 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ea3925fc-a312-45a3-8bdd-bad164a7ce7c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:45.485472 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ea3925fc-a312-45a3-8bdd-bad164a7ce7c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:45.485976 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ea3925fc-a312-45a3-8bdd-bad164a7ce7c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:45.703778 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-ea3925fc-a312-45a3-8bdd-bad164a7ce7c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:45.711723 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-ea3925fc-a312-45a3-8bdd-bad164a7ce7c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1" status: 200 len: 1364 microversion: 2.1 time: 0.244661 Dec 16 15:53:45.712568 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 347/738] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:53:45 2021] GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1 => generated 1364 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:53:45.726837 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-a6fc8941-d4e8-4aae-aaab-d8d69fbce0d3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:45.727435 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-a6fc8941-d4e8-4aae-aaab-d8d69fbce0d3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:45.733491 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a6fc8941-d4e8-4aae-aaab-d8d69fbce0d3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:45.734169 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a6fc8941-d4e8-4aae-aaab-d8d69fbce0d3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:45.735129 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a6fc8941-d4e8-4aae-aaab-d8d69fbce0d3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:45.735665 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a6fc8941-d4e8-4aae-aaab-d8d69fbce0d3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:45.918813 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-a6fc8941-d4e8-4aae-aaab-d8d69fbce0d3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:45.929692 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-a6fc8941-d4e8-4aae-aaab-d8d69fbce0d3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:45.931645 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-a6fc8941-d4e8-4aae-aaab-d8d69fbce0d3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:45.933741 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-a6fc8941-d4e8-4aae-aaab-d8d69fbce0d3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1741 microversion: 2.20 time: 0.210834 Dec 16 15:53:45.934796 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 392/739] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:53:45 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1741 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:53:46.211059 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-9b6245c6-10ad-4535-8970-56be1ad2f5cc req-1e994182-4587-47fa-9c04-b71bb7b97321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635ee3bb-dc82-4d25-95fc-ef55d01f0705", "name": "network-vif-plugged", "status": "completed", "tag": "d48abd91-ed3c-4f04-8767-5e6f0211d6fe"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:46.213309 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:53:46.213309 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:53:46.225666 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-9b6245c6-10ad-4535-8970-56be1ad2f5cc req-1e994182-4587-47fa-9c04-b71bb7b97321 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:46.226214 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-9b6245c6-10ad-4535-8970-56be1ad2f5cc req-1e994182-4587-47fa-9c04-b71bb7b97321 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:46.238337 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-9b6245c6-10ad-4535-8970-56be1ad2f5cc req-1e994182-4587-47fa-9c04-b71bb7b97321 service nova] Creating event network-vif-plugged:d48abd91-ed3c-4f04-8767-5e6f0211d6fe for instance 635ee3bb-dc82-4d25-95fc-ef55d01f0705 on hv-cinder-78447 Dec 16 15:53:46.244661 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-9b6245c6-10ad-4535-8970-56be1ad2f5cc req-1e994182-4587-47fa-9c04-b71bb7b97321 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038779 Dec 16 15:53:46.246245 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 348/740] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:53:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:53:46.728679 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-f02ff54e-e15f-4b5d-b225-e50ee774b93b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:46.730041 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-f02ff54e-e15f-4b5d-b225-e50ee774b93b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:46.736913 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f02ff54e-e15f-4b5d-b225-e50ee774b93b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:46.737472 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f02ff54e-e15f-4b5d-b225-e50ee774b93b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:46.738331 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f02ff54e-e15f-4b5d-b225-e50ee774b93b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:46.739113 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f02ff54e-e15f-4b5d-b225-e50ee774b93b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:46.876493 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-f02ff54e-e15f-4b5d-b225-e50ee774b93b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:46.884263 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-f02ff54e-e15f-4b5d-b225-e50ee774b93b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1" status: 200 len: 1364 microversion: 2.1 time: 0.159314 Dec 16 15:53:46.885436 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 393/741] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:53:46 2021] GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:53:46.952608 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-21efbd23-fd78-40d2-a3cc-82ad4665f2c1 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:46.954007 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-21efbd23-fd78-40d2-a3cc-82ad4665f2c1 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:46.962603 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-21efbd23-fd78-40d2-a3cc-82ad4665f2c1 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:46.963150 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-21efbd23-fd78-40d2-a3cc-82ad4665f2c1 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:46.964105 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-21efbd23-fd78-40d2-a3cc-82ad4665f2c1 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:46.964800 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-21efbd23-fd78-40d2-a3cc-82ad4665f2c1 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:47.127034 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-21efbd23-fd78-40d2-a3cc-82ad4665f2c1 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:47.137841 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-21efbd23-fd78-40d2-a3cc-82ad4665f2c1 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:47.139317 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-21efbd23-fd78-40d2-a3cc-82ad4665f2c1 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:47.140675 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-21efbd23-fd78-40d2-a3cc-82ad4665f2c1 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1741 microversion: 2.20 time: 0.192266 Dec 16 15:53:47.151354 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 349/742] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:53:46 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1741 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:53:47.901807 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-c234e8e0-b201-48a3-8d05-73f72df1f113 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:47.902432 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-c234e8e0-b201-48a3-8d05-73f72df1f113 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:47.909248 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c234e8e0-b201-48a3-8d05-73f72df1f113 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:47.909730 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c234e8e0-b201-48a3-8d05-73f72df1f113 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:47.910572 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c234e8e0-b201-48a3-8d05-73f72df1f113 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:47.911007 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c234e8e0-b201-48a3-8d05-73f72df1f113 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:48.049837 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-c234e8e0-b201-48a3-8d05-73f72df1f113 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:48.058268 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-c234e8e0-b201-48a3-8d05-73f72df1f113 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1" status: 200 len: 1364 microversion: 2.1 time: 0.159515 Dec 16 15:53:48.062886 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 394/743] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:53:47 2021] GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:53:48.158946 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-9c382e55-a5aa-45cc-abfb-c94cda77f1f8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:48.159515 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-9c382e55-a5aa-45cc-abfb-c94cda77f1f8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:48.166098 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9c382e55-a5aa-45cc-abfb-c94cda77f1f8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:48.166791 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9c382e55-a5aa-45cc-abfb-c94cda77f1f8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:48.168534 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9c382e55-a5aa-45cc-abfb-c94cda77f1f8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:48.169334 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9c382e55-a5aa-45cc-abfb-c94cda77f1f8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:48.332501 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-9c382e55-a5aa-45cc-abfb-c94cda77f1f8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:48.341676 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-9c382e55-a5aa-45cc-abfb-c94cda77f1f8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:48.343486 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-9c382e55-a5aa-45cc-abfb-c94cda77f1f8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:48.344658 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-9c382e55-a5aa-45cc-abfb-c94cda77f1f8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1741 microversion: 2.20 time: 0.189609 Dec 16 15:53:48.345218 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 350/744] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:53:48 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1741 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:53:49.075093 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-b39496cd-4731-4adc-b9ed-d691eb875086 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:49.076501 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-b39496cd-4731-4adc-b9ed-d691eb875086 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:49.083170 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b39496cd-4731-4adc-b9ed-d691eb875086 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:49.083626 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b39496cd-4731-4adc-b9ed-d691eb875086 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:49.084475 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b39496cd-4731-4adc-b9ed-d691eb875086 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:49.084906 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b39496cd-4731-4adc-b9ed-d691eb875086 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:49.258434 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-b39496cd-4731-4adc-b9ed-d691eb875086 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:49.266065 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-b39496cd-4731-4adc-b9ed-d691eb875086 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1" status: 200 len: 1364 microversion: 2.1 time: 0.195620 Dec 16 15:53:49.266924 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 395/745] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:53:49 2021] GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1 => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:53:49.362892 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-947af1d1-002d-497f-8ff1-33b83319585c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:49.363645 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-947af1d1-002d-497f-8ff1-33b83319585c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:49.370337 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-947af1d1-002d-497f-8ff1-33b83319585c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:49.371013 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-947af1d1-002d-497f-8ff1-33b83319585c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:49.372103 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-947af1d1-002d-497f-8ff1-33b83319585c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:49.372702 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-947af1d1-002d-497f-8ff1-33b83319585c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:49.528454 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-947af1d1-002d-497f-8ff1-33b83319585c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:49.537224 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-947af1d1-002d-497f-8ff1-33b83319585c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:49.538857 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-947af1d1-002d-497f-8ff1-33b83319585c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:49.540278 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-947af1d1-002d-497f-8ff1-33b83319585c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1741 microversion: 2.20 time: 0.181493 Dec 16 15:53:49.543880 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 351/746] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:53:49 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1741 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:53:50.282951 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-2c45981c-a73b-478a-899f-685b51e70f48 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:50.283537 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-2c45981c-a73b-478a-899f-685b51e70f48 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:50.290375 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2c45981c-a73b-478a-899f-685b51e70f48 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:50.291190 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2c45981c-a73b-478a-899f-685b51e70f48 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:50.292293 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2c45981c-a73b-478a-899f-685b51e70f48 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:50.292791 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2c45981c-a73b-478a-899f-685b51e70f48 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:50.442248 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-2c45981c-a73b-478a-899f-685b51e70f48 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:50.457534 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-2c45981c-a73b-478a-899f-685b51e70f48 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1" status: 200 len: 1364 microversion: 2.1 time: 0.178325 Dec 16 15:53:50.459204 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 396/747] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:53:50 2021] GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1 => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:53:50.564699 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-f832ab0c-6b36-4f44-b7fe-219e58a5c15a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:50.565299 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-f832ab0c-6b36-4f44-b7fe-219e58a5c15a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:50.572836 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f832ab0c-6b36-4f44-b7fe-219e58a5c15a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:50.573210 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f832ab0c-6b36-4f44-b7fe-219e58a5c15a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:50.574008 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f832ab0c-6b36-4f44-b7fe-219e58a5c15a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:50.574427 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f832ab0c-6b36-4f44-b7fe-219e58a5c15a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:50.726426 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-f832ab0c-6b36-4f44-b7fe-219e58a5c15a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:50.734546 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-f832ab0c-6b36-4f44-b7fe-219e58a5c15a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:50.736029 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-f832ab0c-6b36-4f44-b7fe-219e58a5c15a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:50.737232 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-f832ab0c-6b36-4f44-b7fe-219e58a5c15a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1741 microversion: 2.20 time: 0.178501 Dec 16 15:53:50.737846 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 352/748] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:53:50 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1741 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:53:51.546616 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-c4f6c291-85a6-4078-8d1e-e6b4e4275ccb tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:51.547312 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-c4f6c291-85a6-4078-8d1e-e6b4e4275ccb tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:51.553925 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c4f6c291-85a6-4078-8d1e-e6b4e4275ccb tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:51.554398 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c4f6c291-85a6-4078-8d1e-e6b4e4275ccb tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:51.555204 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c4f6c291-85a6-4078-8d1e-e6b4e4275ccb tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:51.555681 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c4f6c291-85a6-4078-8d1e-e6b4e4275ccb tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:51.758487 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-a53d7001-5936-414a-9e9a-159b431f5c2b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:51.761872 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-a53d7001-5936-414a-9e9a-159b431f5c2b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:51.769475 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a53d7001-5936-414a-9e9a-159b431f5c2b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:51.770257 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a53d7001-5936-414a-9e9a-159b431f5c2b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:51.771122 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a53d7001-5936-414a-9e9a-159b431f5c2b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:51.771840 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a53d7001-5936-414a-9e9a-159b431f5c2b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:52.008863 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-c4f6c291-85a6-4078-8d1e-e6b4e4275ccb tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:52.026212 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-c4f6c291-85a6-4078-8d1e-e6b4e4275ccb tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1" status: 200 len: 1364 microversion: 2.1 time: 0.554706 Dec 16 15:53:52.026872 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 397/749] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:53:51 2021] GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1 => generated 1364 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:53:52.077556 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-a53d7001-5936-414a-9e9a-159b431f5c2b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:52.086978 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-a53d7001-5936-414a-9e9a-159b431f5c2b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:52.088748 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-a53d7001-5936-414a-9e9a-159b431f5c2b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:52.090250 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-a53d7001-5936-414a-9e9a-159b431f5c2b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1741 microversion: 2.20 time: 0.338037 Dec 16 15:53:52.090997 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 353/750] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:53:51 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1741 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:53:52.115973 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-ef544720-60c6-4c0b-bdda-568910010847 req-dc3ee099-6574-4f96-888b-22faa2d09b32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a13b434-9d4a-4c31-80e7-96e6d17580f1", "name": "network-vif-plugged", "status": "completed", "tag": "9f9dc2a3-5ad0-4f17-8e45-49ed4219d918"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:52.118209 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:53:52.118209 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:53:52.128440 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-ef544720-60c6-4c0b-bdda-568910010847 req-dc3ee099-6574-4f96-888b-22faa2d09b32 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:52.129339 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-ef544720-60c6-4c0b-bdda-568910010847 req-dc3ee099-6574-4f96-888b-22faa2d09b32 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:52.142390 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-ef544720-60c6-4c0b-bdda-568910010847 req-dc3ee099-6574-4f96-888b-22faa2d09b32 service nova] Creating event network-vif-plugged:9f9dc2a3-5ad0-4f17-8e45-49ed4219d918 for instance 2a13b434-9d4a-4c31-80e7-96e6d17580f1 on hv-cinder-78447 Dec 16 15:53:52.148085 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-ef544720-60c6-4c0b-bdda-568910010847 req-dc3ee099-6574-4f96-888b-22faa2d09b32 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035627 Dec 16 15:53:52.148911 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 398/751] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:53:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:53:53.046684 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-f5be1c45-a7d4-40b5-9044-adad4605e7e6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:53.047706 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-f5be1c45-a7d4-40b5-9044-adad4605e7e6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:53.058064 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f5be1c45-a7d4-40b5-9044-adad4605e7e6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:53.058706 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f5be1c45-a7d4-40b5-9044-adad4605e7e6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:53.059975 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f5be1c45-a7d4-40b5-9044-adad4605e7e6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:53.060695 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f5be1c45-a7d4-40b5-9044-adad4605e7e6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:53.110278 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-6d1c659f-ec52-48ff-94b0-4d132a24fc94 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:53.110933 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-6d1c659f-ec52-48ff-94b0-4d132a24fc94 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:53.117288 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6d1c659f-ec52-48ff-94b0-4d132a24fc94 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:53.117783 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6d1c659f-ec52-48ff-94b0-4d132a24fc94 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:53.118552 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6d1c659f-ec52-48ff-94b0-4d132a24fc94 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:53.119194 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6d1c659f-ec52-48ff-94b0-4d132a24fc94 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:53.222763 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-f5be1c45-a7d4-40b5-9044-adad4605e7e6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:53.230422 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-f5be1c45-a7d4-40b5-9044-adad4605e7e6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1" status: 200 len: 1364 microversion: 2.1 time: 0.189891 Dec 16 15:53:53.230964 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 354/752] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:53:53 2021] GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1 => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:53:53.280216 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-6d1c659f-ec52-48ff-94b0-4d132a24fc94 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:53.292046 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-6d1c659f-ec52-48ff-94b0-4d132a24fc94 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:53.293694 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-6d1c659f-ec52-48ff-94b0-4d132a24fc94 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:53.295381 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-6d1c659f-ec52-48ff-94b0-4d132a24fc94 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1741 microversion: 2.20 time: 0.189538 Dec 16 15:53:53.296151 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 399/753] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:53:53 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1741 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:53:54.251284 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-b84b76c4-102d-4431-8d00-5c30a037d091 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:54.252294 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-b84b76c4-102d-4431-8d00-5c30a037d091 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:54.263038 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b84b76c4-102d-4431-8d00-5c30a037d091 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:54.263772 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b84b76c4-102d-4431-8d00-5c30a037d091 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:54.265081 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b84b76c4-102d-4431-8d00-5c30a037d091 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:54.265887 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b84b76c4-102d-4431-8d00-5c30a037d091 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:54.315928 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-855ad668-d0d0-46e8-a16a-24c93aac2423 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:54.316564 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-855ad668-d0d0-46e8-a16a-24c93aac2423 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:54.323901 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-855ad668-d0d0-46e8-a16a-24c93aac2423 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:54.324247 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-855ad668-d0d0-46e8-a16a-24c93aac2423 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:54.325024 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-855ad668-d0d0-46e8-a16a-24c93aac2423 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:54.325438 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-855ad668-d0d0-46e8-a16a-24c93aac2423 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:54.553459 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-b84b76c4-102d-4431-8d00-5c30a037d091 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:54.561508 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-b84b76c4-102d-4431-8d00-5c30a037d091 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1" status: 200 len: 1364 microversion: 2.1 time: 0.316520 Dec 16 15:53:54.562327 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 355/754] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:53:54 2021] GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1 => generated 1364 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:53:54.607745 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-855ad668-d0d0-46e8-a16a-24c93aac2423 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:54.617384 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-855ad668-d0d0-46e8-a16a-24c93aac2423 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:54.618940 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-855ad668-d0d0-46e8-a16a-24c93aac2423 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:54.620153 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-855ad668-d0d0-46e8-a16a-24c93aac2423 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1741 microversion: 2.20 time: 0.307984 Dec 16 15:53:54.631210 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 400/755] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:53:54 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1741 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:53:55.580718 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-6e6ae106-88f1-4aa0-85b9-b59b8b5cb6bb tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:55.581569 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-6e6ae106-88f1-4aa0-85b9-b59b8b5cb6bb tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:55.588980 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6e6ae106-88f1-4aa0-85b9-b59b8b5cb6bb tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:55.589432 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6e6ae106-88f1-4aa0-85b9-b59b8b5cb6bb tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:55.590209 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6e6ae106-88f1-4aa0-85b9-b59b8b5cb6bb tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:55.590637 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6e6ae106-88f1-4aa0-85b9-b59b8b5cb6bb tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:55.638710 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-a2556deb-e87c-437c-82eb-3d58288ce94b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:55.639328 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-a2556deb-e87c-437c-82eb-3d58288ce94b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:55.645779 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a2556deb-e87c-437c-82eb-3d58288ce94b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:55.646231 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a2556deb-e87c-437c-82eb-3d58288ce94b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:55.647052 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a2556deb-e87c-437c-82eb-3d58288ce94b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:55.647484 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a2556deb-e87c-437c-82eb-3d58288ce94b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:55.754558 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-6e6ae106-88f1-4aa0-85b9-b59b8b5cb6bb tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:55.762072 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-6e6ae106-88f1-4aa0-85b9-b59b8b5cb6bb tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1" status: 200 len: 1364 microversion: 2.1 time: 0.186362 Dec 16 15:53:55.762646 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 356/756] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:53:55 2021] GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1 => generated 1364 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:53:55.815409 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-a2556deb-e87c-437c-82eb-3d58288ce94b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:55.827081 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-a2556deb-e87c-437c-82eb-3d58288ce94b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:55.829358 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-a2556deb-e87c-437c-82eb-3d58288ce94b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:55.831091 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-a2556deb-e87c-437c-82eb-3d58288ce94b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1723 microversion: 2.20 time: 0.195930 Dec 16 15:53:55.831877 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 401/757] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:53:55 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:53:56.783570 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-4f536860-fca0-49cd-a7d1-eb1bbb1d408e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:56.784427 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-4f536860-fca0-49cd-a7d1-eb1bbb1d408e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:56.791985 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4f536860-fca0-49cd-a7d1-eb1bbb1d408e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:56.792426 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4f536860-fca0-49cd-a7d1-eb1bbb1d408e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:56.793167 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4f536860-fca0-49cd-a7d1-eb1bbb1d408e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:56.793659 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4f536860-fca0-49cd-a7d1-eb1bbb1d408e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:56.850894 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-989e74f9-a597-4fa6-b763-8b6d0551b3a0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:56.851480 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-989e74f9-a597-4fa6-b763-8b6d0551b3a0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:56.857942 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-989e74f9-a597-4fa6-b763-8b6d0551b3a0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:56.858386 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-989e74f9-a597-4fa6-b763-8b6d0551b3a0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:56.859255 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-989e74f9-a597-4fa6-b763-8b6d0551b3a0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:56.859693 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-989e74f9-a597-4fa6-b763-8b6d0551b3a0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:56.966942 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-4f536860-fca0-49cd-a7d1-eb1bbb1d408e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:56.975230 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-4f536860-fca0-49cd-a7d1-eb1bbb1d408e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1" status: 200 len: 1364 microversion: 2.1 time: 0.197039 Dec 16 15:53:56.975810 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 357/758] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:53:56 2021] GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1 => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:53:57.034083 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-989e74f9-a597-4fa6-b763-8b6d0551b3a0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:57.047223 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-989e74f9-a597-4fa6-b763-8b6d0551b3a0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:57.050257 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-989e74f9-a597-4fa6-b763-8b6d0551b3a0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:57.051947 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-989e74f9-a597-4fa6-b763-8b6d0551b3a0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1723 microversion: 2.20 time: 0.205213 Dec 16 15:53:57.052503 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 402/759] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:53:56 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:53:57.992211 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-e70aebc2-fa88-408e-8311-68eae1b8190a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:57.992843 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-e70aebc2-fa88-408e-8311-68eae1b8190a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:57.999464 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e70aebc2-fa88-408e-8311-68eae1b8190a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:58.000040 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e70aebc2-fa88-408e-8311-68eae1b8190a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:58.000955 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e70aebc2-fa88-408e-8311-68eae1b8190a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:58.001443 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e70aebc2-fa88-408e-8311-68eae1b8190a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:58.070755 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-e645d0ec-74e2-4dee-a337-f8582581b13c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:58.071353 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-e645d0ec-74e2-4dee-a337-f8582581b13c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:58.078995 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e645d0ec-74e2-4dee-a337-f8582581b13c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:58.079663 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e645d0ec-74e2-4dee-a337-f8582581b13c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:58.080842 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e645d0ec-74e2-4dee-a337-f8582581b13c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:58.081268 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e645d0ec-74e2-4dee-a337-f8582581b13c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:58.176427 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-e70aebc2-fa88-408e-8311-68eae1b8190a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:58.185191 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-e70aebc2-fa88-408e-8311-68eae1b8190a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1" status: 200 len: 1364 microversion: 2.1 time: 0.196766 Dec 16 15:53:58.186279 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 358/760] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:53:57 2021] GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1 => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:53:58.191265 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-005a5cf7-0983-48a0-ac2d-491032148788 req-ca8b881d-d937-4797-97b1-e4b7ff1ba643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635ee3bb-dc82-4d25-95fc-ef55d01f0705", "name": "network-vif-unplugged", "status": "completed", "tag": "d48abd91-ed3c-4f04-8767-5e6f0211d6fe"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:58.192771 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:53:58.192771 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:53:58.203309 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-005a5cf7-0983-48a0-ac2d-491032148788 req-ca8b881d-d937-4797-97b1-e4b7ff1ba643 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:58.203742 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-005a5cf7-0983-48a0-ac2d-491032148788 req-ca8b881d-d937-4797-97b1-e4b7ff1ba643 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:58.215096 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-005a5cf7-0983-48a0-ac2d-491032148788 req-ca8b881d-d937-4797-97b1-e4b7ff1ba643 service nova] Creating event network-vif-unplugged:d48abd91-ed3c-4f04-8767-5e6f0211d6fe for instance 635ee3bb-dc82-4d25-95fc-ef55d01f0705 on hv-cinder-78447 Dec 16 15:53:58.220308 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-005a5cf7-0983-48a0-ac2d-491032148788 req-ca8b881d-d937-4797-97b1-e4b7ff1ba643 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032771 Dec 16 15:53:58.220982 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 359/761] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:53:58 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:53:58.251002 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-e645d0ec-74e2-4dee-a337-f8582581b13c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:58.259737 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-e645d0ec-74e2-4dee-a337-f8582581b13c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:58.261531 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-e645d0ec-74e2-4dee-a337-f8582581b13c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:58.262948 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-e645d0ec-74e2-4dee-a337-f8582581b13c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1723 microversion: 2.20 time: 0.196685 Dec 16 15:53:58.263623 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 403/762] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:53:58 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:53:59.203261 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-c614e6d0-6de6-4e26-b956-e9af09525d7c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:59.203866 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-c614e6d0-6de6-4e26-b956-e9af09525d7c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:59.210035 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c614e6d0-6de6-4e26-b956-e9af09525d7c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:59.210478 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c614e6d0-6de6-4e26-b956-e9af09525d7c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:59.211240 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c614e6d0-6de6-4e26-b956-e9af09525d7c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:59.211662 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c614e6d0-6de6-4e26-b956-e9af09525d7c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:59.281911 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-0cae30f1-c881-403f-a646-7c6dc601b37f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:59.282497 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-0cae30f1-c881-403f-a646-7c6dc601b37f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:59.288864 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0cae30f1-c881-403f-a646-7c6dc601b37f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:59.289307 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0cae30f1-c881-403f-a646-7c6dc601b37f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:59.290140 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0cae30f1-c881-403f-a646-7c6dc601b37f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:59.290571 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0cae30f1-c881-403f-a646-7c6dc601b37f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:59.381722 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-c614e6d0-6de6-4e26-b956-e9af09525d7c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:59.389452 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-c614e6d0-6de6-4e26-b956-e9af09525d7c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1" status: 200 len: 1550 microversion: 2.1 time: 0.190765 Dec 16 15:53:59.390064 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 360/763] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:53:59 2021] GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1 => generated 1550 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:53:59.407936 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-bcb6700d-7e66-49d8-901f-2a996848e049 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:53:59.408434 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-bcb6700d-7e66-49d8-901f-2a996848e049 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:59.414518 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-bcb6700d-7e66-49d8-901f-2a996848e049 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:59.414958 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-bcb6700d-7e66-49d8-901f-2a996848e049 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:59.415733 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-bcb6700d-7e66-49d8-901f-2a996848e049 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:59.416184 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-bcb6700d-7e66-49d8-901f-2a996848e049 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:59.446303 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-0cae30f1-c881-403f-a646-7c6dc601b37f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:59.454350 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-0cae30f1-c881-403f-a646-7c6dc601b37f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:59.455746 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-0cae30f1-c881-403f-a646-7c6dc601b37f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:53:59.456904 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-0cae30f1-c881-403f-a646-7c6dc601b37f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1666 microversion: 2.20 time: 0.178701 Dec 16 15:53:59.457479 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 404/764] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:53:59 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1666 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:53:59.474866 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-cbc74543-0805-4d26-9ccf-3f66ff9183d3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c488d14-e5f0-40e1-b953-a1caca7de19a"}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:59.476035 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-cbc74543-0805-4d26-9ccf-3f66ff9183d3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:59.482355 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-cbc74543-0805-4d26-9ccf-3f66ff9183d3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:59.482765 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-cbc74543-0805-4d26-9ccf-3f66ff9183d3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:59.483760 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-cbc74543-0805-4d26-9ccf-3f66ff9183d3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:59.484398 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-cbc74543-0805-4d26-9ccf-3f66ff9183d3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:59.499390 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-bcb6700d-7e66-49d8-901f-2a996848e049 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094965 Dec 16 15:53:59.500009 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 361/765] 10.222.0.31 () {58 vars in 1274 bytes} [Thu Dec 16 15:53:59 2021] GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:53:59.779221 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-cbc74543-0805-4d26-9ccf-3f66ff9183d3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.308297 Dec 16 15:53:59.779841 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 405/766] 10.222.0.31 () {62 vars in 1363 bytes} [Thu Dec 16 15:53:59 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/os-volume_attachments => generated 188 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:53:59.891564 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-693514ff-d81c-48c2-81df-2b32c6d5e6db tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:53:59.892202 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-693514ff-d81c-48c2-81df-2b32c6d5e6db tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:53:59.898093 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-693514ff-d81c-48c2-81df-2b32c6d5e6db tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:59.898533 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-693514ff-d81c-48c2-81df-2b32c6d5e6db tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:53:59.899290 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-693514ff-d81c-48c2-81df-2b32c6d5e6db tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:53:59.899778 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-693514ff-d81c-48c2-81df-2b32c6d5e6db tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:00.034026 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-693514ff-d81c-48c2-81df-2b32c6d5e6db tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action" status: 202 len: 0 microversion: 2.20 time: 0.146324 Dec 16 15:54:00.034944 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 362/767] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:53:59 2021] POST /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:54:00.044682 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-4a15793e-893a-41d8-a11c-2fd6815a251d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:00.045535 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-4a15793e-893a-41d8-a11c-2fd6815a251d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:00.057849 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4a15793e-893a-41d8-a11c-2fd6815a251d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:00.058636 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4a15793e-893a-41d8-a11c-2fd6815a251d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:00.060356 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4a15793e-893a-41d8-a11c-2fd6815a251d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:00.060937 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4a15793e-893a-41d8-a11c-2fd6815a251d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:00.250562 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-4a15793e-893a-41d8-a11c-2fd6815a251d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:00.260427 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-4a15793e-893a-41d8-a11c-2fd6815a251d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:00.262185 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-4a15793e-893a-41d8-a11c-2fd6815a251d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:00.263350 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-4a15793e-893a-41d8-a11c-2fd6815a251d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1752 microversion: 2.20 time: 0.224377 Dec 16 15:54:00.265144 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 406/768] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:54:00 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1752 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:54:00.723218 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-767f7e59-2cfc-40bf-a9d5-9d06120d804b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:00.724136 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-767f7e59-2cfc-40bf-a9d5-9d06120d804b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:00.731765 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-767f7e59-2cfc-40bf-a9d5-9d06120d804b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:00.732206 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-767f7e59-2cfc-40bf-a9d5-9d06120d804b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:00.732986 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-767f7e59-2cfc-40bf-a9d5-9d06120d804b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:00.733442 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-767f7e59-2cfc-40bf-a9d5-9d06120d804b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:00.793155 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-bcb271f9-2f3e-478f-a5fe-fb0ccc606dad req-82ed5d50-cd27-49b4-a110-10135553f9fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a13b434-9d4a-4c31-80e7-96e6d17580f1", "tag": "9f9dc2a3-5ad0-4f17-8e45-49ed4219d918"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:00.796237 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:54:00.796237 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:54:00.798153 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-767f7e59-2cfc-40bf-a9d5-9d06120d804b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action" status: 200 len: 14 microversion: 2.1 time: 0.082294 Dec 16 15:54:00.799197 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 363/769] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:54:00 2021] POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:54:00.804584 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-bcb271f9-2f3e-478f-a5fe-fb0ccc606dad req-82ed5d50-cd27-49b4-a110-10135553f9fd service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:00.805022 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-bcb271f9-2f3e-478f-a5fe-fb0ccc606dad req-82ed5d50-cd27-49b4-a110-10135553f9fd service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:00.816641 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-bcb271f9-2f3e-478f-a5fe-fb0ccc606dad req-82ed5d50-cd27-49b4-a110-10135553f9fd service nova] Creating event network-changed:9f9dc2a3-5ad0-4f17-8e45-49ed4219d918 for instance 2a13b434-9d4a-4c31-80e7-96e6d17580f1 on hv-cinder-78447 Dec 16 15:54:00.821692 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-bcb271f9-2f3e-478f-a5fe-fb0ccc606dad req-82ed5d50-cd27-49b4-a110-10135553f9fd service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102708 Dec 16 15:54:00.822498 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 407/770] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:54:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:54:01.286313 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-407c6fb6-be3a-438c-af51-db7d0df05157 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:01.287132 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-407c6fb6-be3a-438c-af51-db7d0df05157 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:01.294607 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-407c6fb6-be3a-438c-af51-db7d0df05157 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:01.295402 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-407c6fb6-be3a-438c-af51-db7d0df05157 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:01.296498 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-407c6fb6-be3a-438c-af51-db7d0df05157 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:01.297466 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-407c6fb6-be3a-438c-af51-db7d0df05157 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:01.440010 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-407c6fb6-be3a-438c-af51-db7d0df05157 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:01.448892 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-407c6fb6-be3a-438c-af51-db7d0df05157 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:01.450401 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-407c6fb6-be3a-438c-af51-db7d0df05157 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:01.451564 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-407c6fb6-be3a-438c-af51-db7d0df05157 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1754 microversion: 2.20 time: 0.169373 Dec 16 15:54:01.452155 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 364/771] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:54:01 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:54:01.810921 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-8d36f71c-3d40-4e6d-a7b0-6c3e246e693e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:01.811963 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-8d36f71c-3d40-4e6d-a7b0-6c3e246e693e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:01.819087 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8d36f71c-3d40-4e6d-a7b0-6c3e246e693e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:01.819533 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8d36f71c-3d40-4e6d-a7b0-6c3e246e693e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:01.820329 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8d36f71c-3d40-4e6d-a7b0-6c3e246e693e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:01.820760 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8d36f71c-3d40-4e6d-a7b0-6c3e246e693e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:01.890111 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-8d36f71c-3d40-4e6d-a7b0-6c3e246e693e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action" status: 200 len: 14 microversion: 2.1 time: 0.083428 Dec 16 15:54:01.892065 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 408/772] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:54:01 2021] POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:54:02.352940 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-166c1526-e61c-4587-8d1b-17928e65a818 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:02.353552 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-166c1526-e61c-4587-8d1b-17928e65a818 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: 1f27297a-359e-4f6d-b435-8c0c7ce84163] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:02.360211 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-166c1526-e61c-4587-8d1b-17928e65a818 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:02.360655 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-166c1526-e61c-4587-8d1b-17928e65a818 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:02.361432 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-166c1526-e61c-4587-8d1b-17928e65a818 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:02.361889 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-166c1526-e61c-4587-8d1b-17928e65a818 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:02.439727 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.objects.instance [None req-166c1526-e61c-4587-8d1b-17928e65a818 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lazy-loading 'services' on Instance uuid 1f27297a-359e-4f6d-b435-8c0c7ce84163 {{(pid=122398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:54:02.470779 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-fdac999e-5fa3-46d2-b9c1-5bcab81fb45b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:02.471820 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-fdac999e-5fa3-46d2-b9c1-5bcab81fb45b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:02.478977 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-fdac999e-5fa3-46d2-b9c1-5bcab81fb45b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:02.479358 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-fdac999e-5fa3-46d2-b9c1-5bcab81fb45b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:02.480141 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-fdac999e-5fa3-46d2-b9c1-5bcab81fb45b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:02.480567 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-fdac999e-5fa3-46d2-b9c1-5bcab81fb45b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:02.530186 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-166c1526-e61c-4587-8d1b-17928e65a818 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "DELETE /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163/os-volume_attachments/e500c9e8-9dc7-4e68-b882-bf553cd83401" status: 202 len: 0 microversion: 2.1 time: 0.180795 Dec 16 15:54:02.531055 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 365/773] 10.222.0.31 () {58 vars in 1415 bytes} [Thu Dec 16 15:54:02 2021] DELETE /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163/os-volume_attachments/e500c9e8-9dc7-4e68-b882-bf553cd83401 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:54:02.636279 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-fdac999e-5fa3-46d2-b9c1-5bcab81fb45b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:02.645064 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-fdac999e-5fa3-46d2-b9c1-5bcab81fb45b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:02.646576 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-fdac999e-5fa3-46d2-b9c1-5bcab81fb45b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:02.647972 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-fdac999e-5fa3-46d2-b9c1-5bcab81fb45b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1810 microversion: 2.20 time: 0.181568 Dec 16 15:54:02.648513 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 409/774] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:54:02 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:54:02.904062 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-04261b84-cbd7-463e-95e0-fdc492b1e236 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:02.905318 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-04261b84-cbd7-463e-95e0-fdc492b1e236 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:02.912092 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-04261b84-cbd7-463e-95e0-fdc492b1e236 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:02.912537 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-04261b84-cbd7-463e-95e0-fdc492b1e236 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:02.913321 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-04261b84-cbd7-463e-95e0-fdc492b1e236 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:02.913789 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-04261b84-cbd7-463e-95e0-fdc492b1e236 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:02.977267 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-04261b84-cbd7-463e-95e0-fdc492b1e236 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action" status: 200 len: 14 microversion: 2.1 time: 0.079422 Dec 16 15:54:02.978125 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 366/775] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:54:02 2021] POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:54:03.648447 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-f800305b-2d30-47e5-9c60-270405319cc4 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:03.649114 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-f800305b-2d30-47e5-9c60-270405319cc4 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: 1f27297a-359e-4f6d-b435-8c0c7ce84163] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:03.656110 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f800305b-2d30-47e5-9c60-270405319cc4 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:03.656556 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f800305b-2d30-47e5-9c60-270405319cc4 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:03.657741 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f800305b-2d30-47e5-9c60-270405319cc4 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:03.658438 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f800305b-2d30-47e5-9c60-270405319cc4 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:03.666978 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-ebb23696-44d5-4b5c-86af-0cc094279ff2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:03.668276 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-ebb23696-44d5-4b5c-86af-0cc094279ff2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:03.675525 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ebb23696-44d5-4b5c-86af-0cc094279ff2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:03.676659 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ebb23696-44d5-4b5c-86af-0cc094279ff2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:03.677665 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ebb23696-44d5-4b5c-86af-0cc094279ff2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:03.678254 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ebb23696-44d5-4b5c-86af-0cc094279ff2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:03.688263 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-f800305b-2d30-47e5-9c60-270405319cc4 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: 1f27297a-359e-4f6d-b435-8c0c7ce84163] Going to try to terminate instance {{(pid=122399) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 15:54:03.770489 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-f800305b-2d30-47e5-9c60-270405319cc4 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "DELETE /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163" status: 204 len: 0 microversion: 2.1 time: 0.125172 Dec 16 15:54:03.771726 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 410/776] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Dec 16 15:54:03 2021] DELETE /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:54:03.783079 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-fe3e25f6-9c71-4a60-935e-3cde6dad8df3 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:03.783768 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-fe3e25f6-9c71-4a60-935e-3cde6dad8df3 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: 1f27297a-359e-4f6d-b435-8c0c7ce84163] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:03.790048 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-fe3e25f6-9c71-4a60-935e-3cde6dad8df3 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:03.790755 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-fe3e25f6-9c71-4a60-935e-3cde6dad8df3 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:03.791715 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-fe3e25f6-9c71-4a60-935e-3cde6dad8df3 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:03.792307 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-fe3e25f6-9c71-4a60-935e-3cde6dad8df3 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:03.833764 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-ebb23696-44d5-4b5c-86af-0cc094279ff2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:03.842260 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-ebb23696-44d5-4b5c-86af-0cc094279ff2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:03.843761 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-ebb23696-44d5-4b5c-86af-0cc094279ff2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:03.844927 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-ebb23696-44d5-4b5c-86af-0cc094279ff2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1810 microversion: 2.20 time: 0.182612 Dec 16 15:54:03.845542 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 367/777] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:54:03 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1810 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:54:03.940091 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-fe3e25f6-9c71-4a60-935e-3cde6dad8df3 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:03.948035 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-fe3e25f6-9c71-4a60-935e-3cde6dad8df3 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163" status: 200 len: 1559 microversion: 2.1 time: 0.169060 Dec 16 15:54:03.948607 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 411/778] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:03 2021] GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:03.989444 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-d72e5ae9-34c9-4c99-91ed-b0ebb23143fc tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:03.991274 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-d72e5ae9-34c9-4c99-91ed-b0ebb23143fc tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:03.999426 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d72e5ae9-34c9-4c99-91ed-b0ebb23143fc tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:03.999850 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d72e5ae9-34c9-4c99-91ed-b0ebb23143fc tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:04.000622 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d72e5ae9-34c9-4c99-91ed-b0ebb23143fc tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:04.001381 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d72e5ae9-34c9-4c99-91ed-b0ebb23143fc tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:04.863784 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-2e9df924-822a-4ab2-a5e4-86180c9d9120 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:04.864431 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-2e9df924-822a-4ab2-a5e4-86180c9d9120 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:04.871281 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2e9df924-822a-4ab2-a5e4-86180c9d9120 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:04.872547 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2e9df924-822a-4ab2-a5e4-86180c9d9120 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:04.873801 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2e9df924-822a-4ab2-a5e4-86180c9d9120 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:04.874545 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2e9df924-822a-4ab2-a5e4-86180c9d9120 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:05.019290 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-2e9df924-822a-4ab2-a5e4-86180c9d9120 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:05.027804 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-2e9df924-822a-4ab2-a5e4-86180c9d9120 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:05.029268 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-2e9df924-822a-4ab2-a5e4-86180c9d9120 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:05.030536 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-2e9df924-822a-4ab2-a5e4-86180c9d9120 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1810 microversion: 2.20 time: 0.170650 Dec 16 15:54:05.031103 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 412/779] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:54:04 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:54:05.035495 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-d228ac64-df52-437a-86a2-cde77377ee4f tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:05.036161 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-d228ac64-df52-437a-86a2-cde77377ee4f tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: 1f27297a-359e-4f6d-b435-8c0c7ce84163] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:05.042639 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d228ac64-df52-437a-86a2-cde77377ee4f tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:05.043086 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d228ac64-df52-437a-86a2-cde77377ee4f tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:05.043856 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d228ac64-df52-437a-86a2-cde77377ee4f tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:05.044288 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d228ac64-df52-437a-86a2-cde77377ee4f tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:05.181460 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-d228ac64-df52-437a-86a2-cde77377ee4f tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:05.189608 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-d228ac64-df52-437a-86a2-cde77377ee4f tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163" status: 200 len: 1559 microversion: 2.1 time: 0.157513 Dec 16 15:54:05.190170 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 413/780] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:05 2021] GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:06.049199 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-e0659cb0-8a49-444c-a25f-1271ccf7ba67 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:06.049957 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-e0659cb0-8a49-444c-a25f-1271ccf7ba67 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:06.057491 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e0659cb0-8a49-444c-a25f-1271ccf7ba67 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:06.058045 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e0659cb0-8a49-444c-a25f-1271ccf7ba67 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:06.058901 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e0659cb0-8a49-444c-a25f-1271ccf7ba67 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:06.059394 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e0659cb0-8a49-444c-a25f-1271ccf7ba67 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:06.197358 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-e0659cb0-8a49-444c-a25f-1271ccf7ba67 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:06.207427 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-e0659cb0-8a49-444c-a25f-1271ccf7ba67 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:06.208887 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-e0659cb0-8a49-444c-a25f-1271ccf7ba67 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:06.210076 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-e0659cb0-8a49-444c-a25f-1271ccf7ba67 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1810 microversion: 2.20 time: 0.165613 Dec 16 15:54:06.210632 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 414/781] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:54:06 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:54:06.215155 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-9ab9f559-de05-455c-b984-db9e50964449 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:06.215746 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-9ab9f559-de05-455c-b984-db9e50964449 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: 1f27297a-359e-4f6d-b435-8c0c7ce84163] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:06.222323 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9ab9f559-de05-455c-b984-db9e50964449 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:06.222761 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9ab9f559-de05-455c-b984-db9e50964449 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:06.223526 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9ab9f559-de05-455c-b984-db9e50964449 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:06.223948 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9ab9f559-de05-455c-b984-db9e50964449 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:06.371920 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-9ab9f559-de05-455c-b984-db9e50964449 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:06.381553 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-9ab9f559-de05-455c-b984-db9e50964449 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163" status: 200 len: 1559 microversion: 2.1 time: 0.169853 Dec 16 15:54:06.382487 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 415/782] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:06 2021] GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:07.230481 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-b07cee67-abff-445b-8fec-bcf5b2a5f32c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:07.231532 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-b07cee67-abff-445b-8fec-bcf5b2a5f32c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:07.239434 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b07cee67-abff-445b-8fec-bcf5b2a5f32c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:07.240064 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b07cee67-abff-445b-8fec-bcf5b2a5f32c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:07.241057 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b07cee67-abff-445b-8fec-bcf5b2a5f32c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:07.241870 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b07cee67-abff-445b-8fec-bcf5b2a5f32c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:07.384109 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-b07cee67-abff-445b-8fec-bcf5b2a5f32c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:07.393917 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-b07cee67-abff-445b-8fec-bcf5b2a5f32c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:07.395565 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-b07cee67-abff-445b-8fec-bcf5b2a5f32c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:07.396828 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-b07cee67-abff-445b-8fec-bcf5b2a5f32c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1810 microversion: 2.20 time: 0.171120 Dec 16 15:54:07.397835 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 416/783] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:54:07 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:54:07.403015 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-8fa5f81a-1e30-460f-956b-1476b6397db0 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:07.403611 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-8fa5f81a-1e30-460f-956b-1476b6397db0 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: 1f27297a-359e-4f6d-b435-8c0c7ce84163] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:07.409845 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8fa5f81a-1e30-460f-956b-1476b6397db0 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:07.410289 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8fa5f81a-1e30-460f-956b-1476b6397db0 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:07.411065 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8fa5f81a-1e30-460f-956b-1476b6397db0 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:07.411486 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8fa5f81a-1e30-460f-956b-1476b6397db0 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:07.549943 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-8fa5f81a-1e30-460f-956b-1476b6397db0 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:07.559450 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-8fa5f81a-1e30-460f-956b-1476b6397db0 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163" status: 200 len: 1559 microversion: 2.1 time: 0.160225 Dec 16 15:54:07.560046 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 417/784] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:07 2021] GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:08.415384 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ac888df3-df9f-49da-be19-aa3bacbc2499 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:08.416140 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-ac888df3-df9f-49da-be19-aa3bacbc2499 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:08.422891 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ac888df3-df9f-49da-be19-aa3bacbc2499 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:08.423348 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ac888df3-df9f-49da-be19-aa3bacbc2499 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:08.424327 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ac888df3-df9f-49da-be19-aa3bacbc2499 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:08.424752 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ac888df3-df9f-49da-be19-aa3bacbc2499 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:08.564555 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-ac888df3-df9f-49da-be19-aa3bacbc2499 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:08.572671 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-ac888df3-df9f-49da-be19-aa3bacbc2499 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:08.574252 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-ac888df3-df9f-49da-be19-aa3bacbc2499 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:08.575405 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-ac888df3-df9f-49da-be19-aa3bacbc2499 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1810 microversion: 2.20 time: 0.164088 Dec 16 15:54:08.575960 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 418/785] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:54:08 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:54:08.580061 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-41b4109d-8184-4e6e-b7d8-0bb1b27da645 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:08.580657 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-41b4109d-8184-4e6e-b7d8-0bb1b27da645 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: 1f27297a-359e-4f6d-b435-8c0c7ce84163] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:08.586043 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-41b4109d-8184-4e6e-b7d8-0bb1b27da645 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:08.586485 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-41b4109d-8184-4e6e-b7d8-0bb1b27da645 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:08.587263 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-41b4109d-8184-4e6e-b7d8-0bb1b27da645 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:08.587692 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-41b4109d-8184-4e6e-b7d8-0bb1b27da645 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:08.720370 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-41b4109d-8184-4e6e-b7d8-0bb1b27da645 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:08.729026 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-41b4109d-8184-4e6e-b7d8-0bb1b27da645 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163" status: 200 len: 1559 microversion: 2.1 time: 0.152003 Dec 16 15:54:08.729677 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 419/786] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:08 2021] GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:09.593609 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-80d8e2c0-b68d-42b0-a328-d9d640466248 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:09.594384 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-80d8e2c0-b68d-42b0-a328-d9d640466248 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:09.600828 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-80d8e2c0-b68d-42b0-a328-d9d640466248 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:09.601272 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-80d8e2c0-b68d-42b0-a328-d9d640466248 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:09.602067 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-80d8e2c0-b68d-42b0-a328-d9d640466248 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:09.602498 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-80d8e2c0-b68d-42b0-a328-d9d640466248 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:09.767743 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-80d8e2c0-b68d-42b0-a328-d9d640466248 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:09.776178 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-80d8e2c0-b68d-42b0-a328-d9d640466248 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:09.777774 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-80d8e2c0-b68d-42b0-a328-d9d640466248 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:09.779116 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-80d8e2c0-b68d-42b0-a328-d9d640466248 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1810 microversion: 2.20 time: 0.189396 Dec 16 15:54:09.779681 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 420/787] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:54:09 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1810 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:54:09.783876 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-3f071c27-1dfd-4399-98d2-50e00d71e098 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:09.784454 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-3f071c27-1dfd-4399-98d2-50e00d71e098 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: 1f27297a-359e-4f6d-b435-8c0c7ce84163] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:09.790031 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3f071c27-1dfd-4399-98d2-50e00d71e098 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:09.790475 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3f071c27-1dfd-4399-98d2-50e00d71e098 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:09.791250 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3f071c27-1dfd-4399-98d2-50e00d71e098 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:09.791681 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3f071c27-1dfd-4399-98d2-50e00d71e098 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:09.937193 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-3f071c27-1dfd-4399-98d2-50e00d71e098 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:09.945839 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-3f071c27-1dfd-4399-98d2-50e00d71e098 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163" status: 200 len: 1559 microversion: 2.1 time: 0.165146 Dec 16 15:54:09.946421 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 421/788] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:09 2021] GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:10.798041 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-cadc9297-bfa4-421a-b017-d0eb2d8fa542 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:10.798866 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-cadc9297-bfa4-421a-b017-d0eb2d8fa542 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:10.805108 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-cadc9297-bfa4-421a-b017-d0eb2d8fa542 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:10.805589 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-cadc9297-bfa4-421a-b017-d0eb2d8fa542 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:10.806365 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-cadc9297-bfa4-421a-b017-d0eb2d8fa542 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:10.806793 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-cadc9297-bfa4-421a-b017-d0eb2d8fa542 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:10.950113 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-cadc9297-bfa4-421a-b017-d0eb2d8fa542 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:10.959260 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-cadc9297-bfa4-421a-b017-d0eb2d8fa542 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:10.960740 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-cadc9297-bfa4-421a-b017-d0eb2d8fa542 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:10.961988 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-cadc9297-bfa4-421a-b017-d0eb2d8fa542 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1810 microversion: 2.20 time: 0.167698 Dec 16 15:54:10.962525 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 422/789] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:54:10 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:54:10.967013 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-6cb935ff-0e2c-44dd-b692-4df11e959353 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:10.967578 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-6cb935ff-0e2c-44dd-b692-4df11e959353 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: 1f27297a-359e-4f6d-b435-8c0c7ce84163] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:10.973991 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6cb935ff-0e2c-44dd-b692-4df11e959353 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:10.974430 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6cb935ff-0e2c-44dd-b692-4df11e959353 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:10.975322 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6cb935ff-0e2c-44dd-b692-4df11e959353 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:10.975812 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6cb935ff-0e2c-44dd-b692-4df11e959353 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:11.117892 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-6cb935ff-0e2c-44dd-b692-4df11e959353 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:11.127271 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-6cb935ff-0e2c-44dd-b692-4df11e959353 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163" status: 200 len: 1559 microversion: 2.1 time: 0.163766 Dec 16 15:54:11.127931 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 423/790] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:10 2021] GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:11.980322 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ae67b6d8-a46e-434e-92bf-5775f29fb5d4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:11.981036 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-ae67b6d8-a46e-434e-92bf-5775f29fb5d4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:11.987718 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ae67b6d8-a46e-434e-92bf-5775f29fb5d4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:11.988167 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ae67b6d8-a46e-434e-92bf-5775f29fb5d4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:11.988909 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ae67b6d8-a46e-434e-92bf-5775f29fb5d4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:11.989554 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ae67b6d8-a46e-434e-92bf-5775f29fb5d4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:12.127091 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-ae67b6d8-a46e-434e-92bf-5775f29fb5d4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:12.135951 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-ae67b6d8-a46e-434e-92bf-5775f29fb5d4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:12.137506 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-ae67b6d8-a46e-434e-92bf-5775f29fb5d4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:12.138686 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-ae67b6d8-a46e-434e-92bf-5775f29fb5d4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1810 microversion: 2.20 time: 0.162128 Dec 16 15:54:12.139255 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 424/791] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:54:11 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:54:12.144673 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-02fea670-e1a3-45c8-a2b1-bb22b36577fc tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:12.145267 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-02fea670-e1a3-45c8-a2b1-bb22b36577fc tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: 1f27297a-359e-4f6d-b435-8c0c7ce84163] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:12.150962 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-02fea670-e1a3-45c8-a2b1-bb22b36577fc tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:12.151404 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-02fea670-e1a3-45c8-a2b1-bb22b36577fc tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:12.152164 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-02fea670-e1a3-45c8-a2b1-bb22b36577fc tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:12.152637 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-02fea670-e1a3-45c8-a2b1-bb22b36577fc tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:12.288277 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-02fea670-e1a3-45c8-a2b1-bb22b36577fc tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:12.297139 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-02fea670-e1a3-45c8-a2b1-bb22b36577fc tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163" status: 200 len: 1559 microversion: 2.1 time: 0.155743 Dec 16 15:54:12.298082 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 425/792] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:12 2021] GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:13.157828 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-d9760bbf-6eb3-45f2-8462-dd38b00bc269 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:13.159056 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-d9760bbf-6eb3-45f2-8462-dd38b00bc269 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:13.166824 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d9760bbf-6eb3-45f2-8462-dd38b00bc269 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:13.167365 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d9760bbf-6eb3-45f2-8462-dd38b00bc269 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:13.168728 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d9760bbf-6eb3-45f2-8462-dd38b00bc269 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:13.169194 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d9760bbf-6eb3-45f2-8462-dd38b00bc269 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:13.319328 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-d9760bbf-6eb3-45f2-8462-dd38b00bc269 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:13.328038 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-d9760bbf-6eb3-45f2-8462-dd38b00bc269 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:13.329570 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-d9760bbf-6eb3-45f2-8462-dd38b00bc269 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:13.330757 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-d9760bbf-6eb3-45f2-8462-dd38b00bc269 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1810 microversion: 2.20 time: 0.177078 Dec 16 15:54:13.331316 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 426/793] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:54:13 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:54:13.335633 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-16bf9ae5-70da-4b21-92ae-4be773f01ef4 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:13.336236 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-16bf9ae5-70da-4b21-92ae-4be773f01ef4 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: 1f27297a-359e-4f6d-b435-8c0c7ce84163] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:13.341728 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-16bf9ae5-70da-4b21-92ae-4be773f01ef4 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:13.342184 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-16bf9ae5-70da-4b21-92ae-4be773f01ef4 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:13.342970 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-16bf9ae5-70da-4b21-92ae-4be773f01ef4 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:13.343398 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-16bf9ae5-70da-4b21-92ae-4be773f01ef4 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:13.493726 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-16bf9ae5-70da-4b21-92ae-4be773f01ef4 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:13.496755 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-16bf9ae5-70da-4b21-92ae-4be773f01ef4 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163" status: 200 len: 1559 microversion: 2.1 time: 0.164398 Dec 16 15:54:13.497345 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 427/794] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:13 2021] GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:14.350521 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-d29a3dd7-593c-49cb-a6d6-05cb55a72fdb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:14.351266 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-d29a3dd7-593c-49cb-a6d6-05cb55a72fdb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:14.358022 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d29a3dd7-593c-49cb-a6d6-05cb55a72fdb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:14.358633 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d29a3dd7-593c-49cb-a6d6-05cb55a72fdb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:14.359474 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d29a3dd7-593c-49cb-a6d6-05cb55a72fdb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:14.359928 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d29a3dd7-593c-49cb-a6d6-05cb55a72fdb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:14.499072 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-d29a3dd7-593c-49cb-a6d6-05cb55a72fdb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:14.508082 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-d29a3dd7-593c-49cb-a6d6-05cb55a72fdb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:14.509608 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-d29a3dd7-593c-49cb-a6d6-05cb55a72fdb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:14.510769 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-d29a3dd7-593c-49cb-a6d6-05cb55a72fdb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1810 microversion: 2.20 time: 0.164977 Dec 16 15:54:14.511334 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 428/795] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:54:14 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:54:14.515748 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-a6433f09-9df2-416a-b3e7-8055f107c560 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:14.516345 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-a6433f09-9df2-416a-b3e7-8055f107c560 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: 1f27297a-359e-4f6d-b435-8c0c7ce84163] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:14.522014 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a6433f09-9df2-416a-b3e7-8055f107c560 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:14.522465 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a6433f09-9df2-416a-b3e7-8055f107c560 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:14.523240 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a6433f09-9df2-416a-b3e7-8055f107c560 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:14.523672 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a6433f09-9df2-416a-b3e7-8055f107c560 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:14.655543 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-a6433f09-9df2-416a-b3e7-8055f107c560 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:14.665100 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-a6433f09-9df2-416a-b3e7-8055f107c560 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163" status: 200 len: 1559 microversion: 2.1 time: 0.152742 Dec 16 15:54:14.665695 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 429/796] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:14 2021] GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:15.469520 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-d72e5ae9-34c9-4c99-91ed-b0ebb23143fc tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action" status: 200 len: 22494 microversion: 2.1 time: 11.484240 Dec 16 15:54:15.471384 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 368/797] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:54:03 2021] POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action => generated 22494 bytes in 11487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:54:15.529291 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-73688c14-b16d-4abd-958d-0133031b1af6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:15.529927 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-73688c14-b16d-4abd-958d-0133031b1af6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:15.536813 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-73688c14-b16d-4abd-958d-0133031b1af6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:15.537260 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-73688c14-b16d-4abd-958d-0133031b1af6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:15.538145 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-73688c14-b16d-4abd-958d-0133031b1af6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:15.538579 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-73688c14-b16d-4abd-958d-0133031b1af6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:15.675420 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-73688c14-b16d-4abd-958d-0133031b1af6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:15.682144 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-d2868ba9-da7d-4c84-8b48-8ec090696620 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:15.682822 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-d2868ba9-da7d-4c84-8b48-8ec090696620 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: 1f27297a-359e-4f6d-b435-8c0c7ce84163] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:15.684304 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-73688c14-b16d-4abd-958d-0133031b1af6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:15.685817 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-73688c14-b16d-4abd-958d-0133031b1af6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:15.686975 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-73688c14-b16d-4abd-958d-0133031b1af6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1810 microversion: 2.20 time: 0.161538 Dec 16 15:54:15.687535 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 430/798] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:54:15 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:54:15.689598 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d2868ba9-da7d-4c84-8b48-8ec090696620 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:15.690044 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d2868ba9-da7d-4c84-8b48-8ec090696620 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:15.690823 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d2868ba9-da7d-4c84-8b48-8ec090696620 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:15.691251 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d2868ba9-da7d-4c84-8b48-8ec090696620 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:15.825361 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-d2868ba9-da7d-4c84-8b48-8ec090696620 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:15.834222 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-d2868ba9-da7d-4c84-8b48-8ec090696620 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163" status: 200 len: 1513 microversion: 2.1 time: 0.156104 Dec 16 15:54:15.834784 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 369/799] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:15 2021] GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:54:16.486757 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-19655379-6f57-4b3b-b0e5-366b0a24ca0e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:16.488135 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-19655379-6f57-4b3b-b0e5-366b0a24ca0e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:16.499578 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-19655379-6f57-4b3b-b0e5-366b0a24ca0e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:16.500378 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-19655379-6f57-4b3b-b0e5-366b0a24ca0e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:16.501711 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-19655379-6f57-4b3b-b0e5-366b0a24ca0e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:16.502154 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-19655379-6f57-4b3b-b0e5-366b0a24ca0e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:16.574757 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-19655379-6f57-4b3b-b0e5-366b0a24ca0e tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action" status: 200 len: 23235 microversion: 2.1 time: 0.093988 Dec 16 15:54:16.575869 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 431/800] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:54:16 2021] POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action => generated 23235 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:54:16.709565 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-490ca72d-d30d-4ff8-abfd-63f634c2dd2b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:16.710593 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-490ca72d-d30d-4ff8-abfd-63f634c2dd2b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:16.721875 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-490ca72d-d30d-4ff8-abfd-63f634c2dd2b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:16.722622 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-490ca72d-d30d-4ff8-abfd-63f634c2dd2b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:16.723896 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-490ca72d-d30d-4ff8-abfd-63f634c2dd2b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:16.724605 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-490ca72d-d30d-4ff8-abfd-63f634c2dd2b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:16.852330 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-87244501-b42b-426d-988b-c2347ce7d7ae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:16.853117 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-87244501-b42b-426d-988b-c2347ce7d7ae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: 1f27297a-359e-4f6d-b435-8c0c7ce84163] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:16.860355 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-87244501-b42b-426d-988b-c2347ce7d7ae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:16.860881 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-87244501-b42b-426d-988b-c2347ce7d7ae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:16.861717 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-87244501-b42b-426d-988b-c2347ce7d7ae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:16.862152 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-87244501-b42b-426d-988b-c2347ce7d7ae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:16.865828 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-490ca72d-d30d-4ff8-abfd-63f634c2dd2b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:16.874974 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-490ca72d-d30d-4ff8-abfd-63f634c2dd2b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:16.876494 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-490ca72d-d30d-4ff8-abfd-63f634c2dd2b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:16.877727 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-490ca72d-d30d-4ff8-abfd-63f634c2dd2b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1810 microversion: 2.20 time: 0.174622 Dec 16 15:54:16.878289 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 370/801] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:54:16 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:54:16.997896 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-87244501-b42b-426d-988b-c2347ce7d7ae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:17.005806 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-87244501-b42b-426d-988b-c2347ce7d7ae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163" status: 200 len: 1513 microversion: 2.1 time: 0.157526 Dec 16 15:54:17.006378 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 432/802] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:16 2021] GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:54:17.588315 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-02383473-b5e8-42fc-8262-f470dc933231 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:17.589277 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-02383473-b5e8-42fc-8262-f470dc933231 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:17.595995 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-02383473-b5e8-42fc-8262-f470dc933231 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:17.596453 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-02383473-b5e8-42fc-8262-f470dc933231 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:17.597217 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-02383473-b5e8-42fc-8262-f470dc933231 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:17.597683 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-02383473-b5e8-42fc-8262-f470dc933231 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:17.670352 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-02383473-b5e8-42fc-8262-f470dc933231 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action" status: 200 len: 24685 microversion: 2.1 time: 0.085494 Dec 16 15:54:17.670983 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 371/803] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:54:17 2021] POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action => generated 24685 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:54:17.765997 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-4be5d0a2-72c2-4b4c-a6b9-350199d50db5 req-9e9b016b-6842-41ca-ba36-1dc92cd96cec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f27297a-359e-4f6d-b435-8c0c7ce84163", "name": "network-vif-deleted", "tag": "97324e88-36de-449c-857f-bc2d3f7a912d"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:17.768046 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:54:17.768046 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:54:17.776895 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-4be5d0a2-72c2-4b4c-a6b9-350199d50db5 req-9e9b016b-6842-41ca-ba36-1dc92cd96cec service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:17.777339 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-4be5d0a2-72c2-4b4c-a6b9-350199d50db5 req-9e9b016b-6842-41ca-ba36-1dc92cd96cec service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:17.788553 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-4be5d0a2-72c2-4b4c-a6b9-350199d50db5 req-9e9b016b-6842-41ca-ba36-1dc92cd96cec service nova] Creating event network-vif-deleted:97324e88-36de-449c-857f-bc2d3f7a912d for instance 1f27297a-359e-4f6d-b435-8c0c7ce84163 on hv-cinder-78447 Dec 16 15:54:17.793555 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-4be5d0a2-72c2-4b4c-a6b9-350199d50db5 req-9e9b016b-6842-41ca-ba36-1dc92cd96cec service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031160 Dec 16 15:54:17.794157 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 433/804] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:54:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:54:17.896846 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-813a8a1c-7c41-47f1-8007-1967bbbea33b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:17.897688 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-813a8a1c-7c41-47f1-8007-1967bbbea33b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:17.904828 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-813a8a1c-7c41-47f1-8007-1967bbbea33b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:17.905276 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-813a8a1c-7c41-47f1-8007-1967bbbea33b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:17.906257 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-813a8a1c-7c41-47f1-8007-1967bbbea33b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:17.907124 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-813a8a1c-7c41-47f1-8007-1967bbbea33b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:18.023312 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-63de5828-cfb8-408b-a0ef-ed7cf6fd3e86 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:18.024000 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-63de5828-cfb8-408b-a0ef-ed7cf6fd3e86 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: 1f27297a-359e-4f6d-b435-8c0c7ce84163] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:18.030591 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-63de5828-cfb8-408b-a0ef-ed7cf6fd3e86 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:18.031032 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-63de5828-cfb8-408b-a0ef-ed7cf6fd3e86 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:18.031801 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-63de5828-cfb8-408b-a0ef-ed7cf6fd3e86 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:18.032225 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-63de5828-cfb8-408b-a0ef-ed7cf6fd3e86 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:18.042885 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-813a8a1c-7c41-47f1-8007-1967bbbea33b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:18.051375 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-813a8a1c-7c41-47f1-8007-1967bbbea33b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:18.052985 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-813a8a1c-7c41-47f1-8007-1967bbbea33b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:18.054169 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-813a8a1c-7c41-47f1-8007-1967bbbea33b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1810 microversion: 2.20 time: 0.161676 Dec 16 15:54:18.054730 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 372/805] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:54:17 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:54:18.063091 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-63de5828-cfb8-408b-a0ef-ed7cf6fd3e86 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:18.063530 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-63de5828-cfb8-408b-a0ef-ed7cf6fd3e86 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:18.064071 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.objects.instance [None req-63de5828-cfb8-408b-a0ef-ed7cf6fd3e86 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lazy-loading 'fault' on Instance uuid 1f27297a-359e-4f6d-b435-8c0c7ce84163 {{(pid=122399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:54:18.107783 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-63de5828-cfb8-408b-a0ef-ed7cf6fd3e86 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:18.114930 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-63de5828-cfb8-408b-a0ef-ed7cf6fd3e86 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163" status: 200 len: 1308 microversion: 2.1 time: 0.095645 Dec 16 15:54:18.115484 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 434/806] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:18 2021] GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:18.685793 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-8962019f-6d62-4d16-a4bd-df7709dc67a0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:18.687375 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-8962019f-6d62-4d16-a4bd-df7709dc67a0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:18.695429 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8962019f-6d62-4d16-a4bd-df7709dc67a0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:18.695872 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8962019f-6d62-4d16-a4bd-df7709dc67a0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:18.696651 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8962019f-6d62-4d16-a4bd-df7709dc67a0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:18.697081 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8962019f-6d62-4d16-a4bd-df7709dc67a0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:18.768054 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-8962019f-6d62-4d16-a4bd-df7709dc67a0 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action" status: 200 len: 26240 microversion: 2.1 time: 0.088314 Dec 16 15:54:18.768626 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 373/807] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:54:18 2021] POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action => generated 26240 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:54:19.077037 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-9a4a944c-5550-44a3-bf86-df5863dcbd02 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:19.078610 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-9a4a944c-5550-44a3-bf86-df5863dcbd02 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:19.086440 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9a4a944c-5550-44a3-bf86-df5863dcbd02 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:19.086908 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9a4a944c-5550-44a3-bf86-df5863dcbd02 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:19.087733 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9a4a944c-5550-44a3-bf86-df5863dcbd02 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:19.088175 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9a4a944c-5550-44a3-bf86-df5863dcbd02 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:19.131443 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-62c54b6c-bb47-41ef-891f-5e3a1ecdd130 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:19.132119 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-62c54b6c-bb47-41ef-891f-5e3a1ecdd130 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: 1f27297a-359e-4f6d-b435-8c0c7ce84163] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:19.139223 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-62c54b6c-bb47-41ef-891f-5e3a1ecdd130 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:19.139670 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-62c54b6c-bb47-41ef-891f-5e3a1ecdd130 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:19.140448 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-62c54b6c-bb47-41ef-891f-5e3a1ecdd130 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:19.140879 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-62c54b6c-bb47-41ef-891f-5e3a1ecdd130 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:19.157924 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.wsgi [None req-62c54b6c-bb47-41ef-891f-5e3a1ecdd130 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] HTTP exception thrown: Instance 1f27297a-359e-4f6d-b435-8c0c7ce84163 could not be found. Dec 16 15:54:19.158500 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-62c54b6c-bb47-41ef-891f-5e3a1ecdd130 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Returning 404 to user: Instance 1f27297a-359e-4f6d-b435-8c0c7ce84163 could not be found. {{(pid=122398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:54:19.159342 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-62c54b6c-bb47-41ef-891f-5e3a1ecdd130 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163" status: 404 len: 111 microversion: 2.1 time: 0.032009 Dec 16 15:54:19.166840 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 374/808] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:19 2021] GET /compute/v2.1/servers/1f27297a-359e-4f6d-b435-8c0c7ce84163 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 16 15:54:19.226256 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-9a4a944c-5550-44a3-bf86-df5863dcbd02 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:19.234833 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-9a4a944c-5550-44a3-bf86-df5863dcbd02 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:19.236258 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-9a4a944c-5550-44a3-bf86-df5863dcbd02 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:19.237521 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-9a4a944c-5550-44a3-bf86-df5863dcbd02 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1810 microversion: 2.20 time: 0.167420 Dec 16 15:54:19.238107 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 435/809] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:54:19 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:54:19.783934 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-feb8b0c5-ab63-4e7a-be1a-9b26e6c11028 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:19.785480 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-feb8b0c5-ab63-4e7a-be1a-9b26e6c11028 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:19.796147 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-feb8b0c5-ab63-4e7a-be1a-9b26e6c11028 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:19.796885 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-feb8b0c5-ab63-4e7a-be1a-9b26e6c11028 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:19.798209 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-feb8b0c5-ab63-4e7a-be1a-9b26e6c11028 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:19.798923 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-feb8b0c5-ab63-4e7a-be1a-9b26e6c11028 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:20.256256 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-db45756e-39ad-4229-920a-ca5d22c22d3d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:20.256887 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-db45756e-39ad-4229-920a-ca5d22c22d3d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:20.263624 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-db45756e-39ad-4229-920a-ca5d22c22d3d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:20.264152 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-db45756e-39ad-4229-920a-ca5d22c22d3d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:20.265436 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-db45756e-39ad-4229-920a-ca5d22c22d3d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:20.265436 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-db45756e-39ad-4229-920a-ca5d22c22d3d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:20.399668 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-db45756e-39ad-4229-920a-ca5d22c22d3d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:20.408093 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-db45756e-39ad-4229-920a-ca5d22c22d3d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:20.409718 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-db45756e-39ad-4229-920a-ca5d22c22d3d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:20.411113 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-db45756e-39ad-4229-920a-ca5d22c22d3d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1810 microversion: 2.20 time: 0.158967 Dec 16 15:54:20.411675 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 436/810] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:54:20 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:54:21.432933 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-18368573-da6b-4aeb-a8e3-27776a26cf0f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:21.434043 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-18368573-da6b-4aeb-a8e3-27776a26cf0f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:21.443204 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-18368573-da6b-4aeb-a8e3-27776a26cf0f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:21.443655 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-18368573-da6b-4aeb-a8e3-27776a26cf0f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:21.444436 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-18368573-da6b-4aeb-a8e3-27776a26cf0f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:21.444868 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-18368573-da6b-4aeb-a8e3-27776a26cf0f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:21.578224 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-18368573-da6b-4aeb-a8e3-27776a26cf0f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:21.587119 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-18368573-da6b-4aeb-a8e3-27776a26cf0f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:21.588597 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-18368573-da6b-4aeb-a8e3-27776a26cf0f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:21.589748 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-18368573-da6b-4aeb-a8e3-27776a26cf0f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1810 microversion: 2.20 time: 0.163104 Dec 16 15:54:21.590337 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 437/811] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:54:21 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:54:22.338849 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-feb8b0c5-ab63-4e7a-be1a-9b26e6c11028 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action" status: 200 len: 27800 microversion: 2.1 time: 2.561017 Dec 16 15:54:22.339411 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 375/812] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:54:19 2021] POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action => generated 27800 bytes in 2563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:54:22.610857 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-98650a23-fd2c-4851-a871-feb1b175ff1c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:22.611427 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-98650a23-fd2c-4851-a871-feb1b175ff1c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:22.617820 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-98650a23-fd2c-4851-a871-feb1b175ff1c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:22.618271 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-98650a23-fd2c-4851-a871-feb1b175ff1c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:22.619044 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-98650a23-fd2c-4851-a871-feb1b175ff1c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:22.619473 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-98650a23-fd2c-4851-a871-feb1b175ff1c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:22.758311 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-98650a23-fd2c-4851-a871-feb1b175ff1c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:22.767184 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-98650a23-fd2c-4851-a871-feb1b175ff1c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:22.768661 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-98650a23-fd2c-4851-a871-feb1b175ff1c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:22.769877 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-98650a23-fd2c-4851-a871-feb1b175ff1c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1810 microversion: 2.20 time: 0.162858 Dec 16 15:54:22.770438 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 438/813] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:54:22 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:54:23.350972 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-099cbd2b-43bc-4fb6-b6b8-d22e313a2881 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:23.352013 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-099cbd2b-43bc-4fb6-b6b8-d22e313a2881 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:23.360111 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-099cbd2b-43bc-4fb6-b6b8-d22e313a2881 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:23.360579 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-099cbd2b-43bc-4fb6-b6b8-d22e313a2881 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:23.361356 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-099cbd2b-43bc-4fb6-b6b8-d22e313a2881 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:23.361827 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-099cbd2b-43bc-4fb6-b6b8-d22e313a2881 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:23.446063 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-099cbd2b-43bc-4fb6-b6b8-d22e313a2881 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action" status: 200 len: 28227 microversion: 2.1 time: 0.098495 Dec 16 15:54:23.447029 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 376/814] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:54:23 2021] POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action => generated 28227 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:54:23.788253 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-4fff4373-8b91-4d01-91ee-325c3792526c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:23.788882 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-4fff4373-8b91-4d01-91ee-325c3792526c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:23.795691 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4fff4373-8b91-4d01-91ee-325c3792526c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:23.796149 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4fff4373-8b91-4d01-91ee-325c3792526c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:23.796938 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4fff4373-8b91-4d01-91ee-325c3792526c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:23.797366 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4fff4373-8b91-4d01-91ee-325c3792526c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:23.942903 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-4fff4373-8b91-4d01-91ee-325c3792526c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:23.952003 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-4fff4373-8b91-4d01-91ee-325c3792526c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:23.953497 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-4fff4373-8b91-4d01-91ee-325c3792526c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:23.954646 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-4fff4373-8b91-4d01-91ee-325c3792526c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1810 microversion: 2.20 time: 0.170227 Dec 16 15:54:23.955207 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 439/815] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:54:23 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:54:24.464891 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-5569c03c-2ab8-4384-94b9-a9d08bcf98ec tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:24.466781 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-5569c03c-2ab8-4384-94b9-a9d08bcf98ec tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:24.478096 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5569c03c-2ab8-4384-94b9-a9d08bcf98ec tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:24.478559 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5569c03c-2ab8-4384-94b9-a9d08bcf98ec tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:24.479330 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5569c03c-2ab8-4384-94b9-a9d08bcf98ec tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:24.479763 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5569c03c-2ab8-4384-94b9-a9d08bcf98ec tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:24.565368 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-5569c03c-2ab8-4384-94b9-a9d08bcf98ec tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action" status: 200 len: 28354 microversion: 2.1 time: 0.106723 Dec 16 15:54:24.566418 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 377/816] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:54:24 2021] POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action => generated 28354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:54:24.977102 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-1142e4c5-3173-44db-8282-d39800a3e002 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:24.977998 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-1142e4c5-3173-44db-8282-d39800a3e002 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:24.988386 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1142e4c5-3173-44db-8282-d39800a3e002 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:24.989062 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1142e4c5-3173-44db-8282-d39800a3e002 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:24.990317 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1142e4c5-3173-44db-8282-d39800a3e002 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:24.991022 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1142e4c5-3173-44db-8282-d39800a3e002 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:25.131801 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-1142e4c5-3173-44db-8282-d39800a3e002 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:25.140681 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-1142e4c5-3173-44db-8282-d39800a3e002 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:25.142215 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-1142e4c5-3173-44db-8282-d39800a3e002 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:25.143377 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-1142e4c5-3173-44db-8282-d39800a3e002 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1810 microversion: 2.20 time: 0.172781 Dec 16 15:54:25.143960 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 440/817] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:54:24 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:54:25.584229 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-44cecd53-f801-4d45-8ed6-6f9050e2bdee tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:25.586116 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-44cecd53-f801-4d45-8ed6-6f9050e2bdee tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:25.593286 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-44cecd53-f801-4d45-8ed6-6f9050e2bdee tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:25.593774 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-44cecd53-f801-4d45-8ed6-6f9050e2bdee tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:25.594552 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-44cecd53-f801-4d45-8ed6-6f9050e2bdee tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:25.594955 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-44cecd53-f801-4d45-8ed6-6f9050e2bdee tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:26.162039 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-25d0b9ed-ff30-443a-a347-2ce128df4ec6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:26.162549 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-25d0b9ed-ff30-443a-a347-2ce128df4ec6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:26.169240 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-25d0b9ed-ff30-443a-a347-2ce128df4ec6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:26.169728 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-25d0b9ed-ff30-443a-a347-2ce128df4ec6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:26.170504 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-25d0b9ed-ff30-443a-a347-2ce128df4ec6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:26.170932 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-25d0b9ed-ff30-443a-a347-2ce128df4ec6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:26.321916 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-25d0b9ed-ff30-443a-a347-2ce128df4ec6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:26.334075 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-25d0b9ed-ff30-443a-a347-2ce128df4ec6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:26.336221 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-25d0b9ed-ff30-443a-a347-2ce128df4ec6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:26.337442 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-25d0b9ed-ff30-443a-a347-2ce128df4ec6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1810 microversion: 2.20 time: 0.179212 Dec 16 15:54:26.338002 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 441/818] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:54:26 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1810 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:54:27.360221 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-e14379f7-35f5-491c-a0f6-914bb2fcf6ac tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:27.360890 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-e14379f7-35f5-491c-a0f6-914bb2fcf6ac tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:27.367375 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e14379f7-35f5-491c-a0f6-914bb2fcf6ac tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:27.367825 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e14379f7-35f5-491c-a0f6-914bb2fcf6ac tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:27.368595 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e14379f7-35f5-491c-a0f6-914bb2fcf6ac tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:27.369024 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e14379f7-35f5-491c-a0f6-914bb2fcf6ac tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:27.505871 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-e14379f7-35f5-491c-a0f6-914bb2fcf6ac tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:27.514232 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-e14379f7-35f5-491c-a0f6-914bb2fcf6ac tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:27.515710 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-e14379f7-35f5-491c-a0f6-914bb2fcf6ac tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:27.516863 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-e14379f7-35f5-491c-a0f6-914bb2fcf6ac tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1810 microversion: 2.20 time: 0.160510 Dec 16 15:54:27.517437 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 442/819] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:54:27 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:54:27.762376 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-44cecd53-f801-4d45-8ed6-6f9050e2bdee tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action" status: 200 len: 28518 microversion: 2.1 time: 2.184404 Dec 16 15:54:27.763242 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 378/820] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:54:25 2021] POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action => generated 28518 bytes in 2188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:54:27.987774 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-97e9eca2-29ad-4f96-9f6a-76c1b0c95dae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-913445669", "imageRef": "2a1434ad-0c2c-4725-baad-a605624baf01", "flavorRef": "452", "networks": [{"uuid": "50d8a135-3436-4a59-8ee6-c5d9e712c029"}]}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:28.040435 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.network.neutron [None req-97e9eca2-29ad-4f96-9f6a-76c1b0c95dae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] validate_networks() for [('50d8a135-3436-4a59-8ee6-c5d9e712c029', None, None, None, None, None)] {{(pid=122399) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 15:54:28.425383 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-97e9eca2-29ad-4f96-9f6a-76c1b0c95dae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Flavor limits 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 15:54:28.426077 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-97e9eca2-29ad-4f96-9f6a-76c1b0c95dae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Image limits 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 15:54:28.426347 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-97e9eca2-29ad-4f96-9f6a-76c1b0c95dae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Flavor pref 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 15:54:28.426928 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-97e9eca2-29ad-4f96-9f6a-76c1b0c95dae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Image pref 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 15:54:28.427526 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-97e9eca2-29ad-4f96-9f6a-76c1b0c95dae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 15:54:28.437841 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-97e9eca2-29ad-4f96-9f6a-76c1b0c95dae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:28.438284 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-97e9eca2-29ad-4f96-9f6a-76c1b0c95dae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:28.439097 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-97e9eca2-29ad-4f96-9f6a-76c1b0c95dae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:28.439524 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-97e9eca2-29ad-4f96-9f6a-76c1b0c95dae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:28.456491 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-97e9eca2-29ad-4f96-9f6a-76c1b0c95dae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Getting quotas for project ebf339789c6548249d10a3fc90824375. Resources: {'instances', 'ram', 'cores'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:54:28.460565 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-97e9eca2-29ad-4f96-9f6a-76c1b0c95dae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Getting quotas for user 7a62c94ccf894508af39e5dda01c2dd4 and project ebf339789c6548249d10a3fc90824375. Resources: {'instances', 'ram', 'cores'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:54:28.472089 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-97e9eca2-29ad-4f96-9f6a-76c1b0c95dae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Going to run 1 instances... {{(pid=122399) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 15:54:28.474472 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-97e9eca2-29ad-4f96-9f6a-76c1b0c95dae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: f8a79670-40b7-4b24-8484-e97517721494] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a1434ad-0c2c-4725-baad-a605624baf01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 15:54:28.519869 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-97e9eca2-29ad-4f96-9f6a-76c1b0c95dae tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535776 Dec 16 15:54:28.520542 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 443/821] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Dec 16 15:54:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 15:54:28.530791 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-7dd4398a-baa1-43e5-9426-cc771a9c3d4d tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:28.531731 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-7dd4398a-baa1-43e5-9426-cc771a9c3d4d tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: f8a79670-40b7-4b24-8484-e97517721494] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:28.536076 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-2787799a-25b4-4077-8dfc-aa25bf180e2e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:28.536686 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-2787799a-25b4-4077-8dfc-aa25bf180e2e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:28.542861 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2787799a-25b4-4077-8dfc-aa25bf180e2e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:28.543313 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2787799a-25b4-4077-8dfc-aa25bf180e2e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:28.544129 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2787799a-25b4-4077-8dfc-aa25bf180e2e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:28.544559 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2787799a-25b4-4077-8dfc-aa25bf180e2e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:28.619459 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-7dd4398a-baa1-43e5-9426-cc771a9c3d4d tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:28.626710 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-7dd4398a-baa1-43e5-9426-cc771a9c3d4d tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494" status: 200 len: 1218 microversion: 2.1 time: 0.099887 Dec 16 15:54:28.627338 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 379/822] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:28 2021] GET /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494 => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:28.696010 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-2787799a-25b4-4077-8dfc-aa25bf180e2e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:28.704206 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-2787799a-25b4-4077-8dfc-aa25bf180e2e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:28.705849 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-2787799a-25b4-4077-8dfc-aa25bf180e2e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:28.706844 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-2787799a-25b4-4077-8dfc-aa25bf180e2e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1810 microversion: 2.20 time: 0.174995 Dec 16 15:54:28.707404 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 444/823] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:54:28 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:54:28.780949 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-401ac122-92a6-4418-8f2c-065f72022652 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:28.782603 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-401ac122-92a6-4418-8f2c-065f72022652 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:28.792036 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-401ac122-92a6-4418-8f2c-065f72022652 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:28.792477 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-401ac122-92a6-4418-8f2c-065f72022652 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:28.793279 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-401ac122-92a6-4418-8f2c-065f72022652 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:28.793772 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-401ac122-92a6-4418-8f2c-065f72022652 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:28.870506 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-401ac122-92a6-4418-8f2c-065f72022652 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action" status: 200 len: 28686 microversion: 2.1 time: 0.096628 Dec 16 15:54:28.871249 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 380/824] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:54:28 2021] POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action => generated 28686 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:54:29.642242 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-7a24da24-acfe-4675-8ac9-db6347592d11 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:29.642844 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-7a24da24-acfe-4675-8ac9-db6347592d11 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: f8a79670-40b7-4b24-8484-e97517721494] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:29.649212 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7a24da24-acfe-4675-8ac9-db6347592d11 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:29.649696 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7a24da24-acfe-4675-8ac9-db6347592d11 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:29.650479 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7a24da24-acfe-4675-8ac9-db6347592d11 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:29.650906 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7a24da24-acfe-4675-8ac9-db6347592d11 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:29.711260 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-7a24da24-acfe-4675-8ac9-db6347592d11 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:29.718658 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-7a24da24-acfe-4675-8ac9-db6347592d11 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494" status: 200 len: 1276 microversion: 2.1 time: 0.080061 Dec 16 15:54:29.719223 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 445/825] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:29 2021] GET /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494 => generated 1276 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:29.725773 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-6416b8fd-fcb7-4f3f-9bf6-c613ba507c5e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:29.726560 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-6416b8fd-fcb7-4f3f-9bf6-c613ba507c5e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:29.733621 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6416b8fd-fcb7-4f3f-9bf6-c613ba507c5e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:29.734062 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6416b8fd-fcb7-4f3f-9bf6-c613ba507c5e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:29.734828 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6416b8fd-fcb7-4f3f-9bf6-c613ba507c5e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:29.735259 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6416b8fd-fcb7-4f3f-9bf6-c613ba507c5e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:29.869538 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-6416b8fd-fcb7-4f3f-9bf6-c613ba507c5e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:29.881472 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-6416b8fd-fcb7-4f3f-9bf6-c613ba507c5e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:29.882419 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-0608d916-cce9-4643-9249-a348f0d138d1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:29.883305 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-6416b8fd-fcb7-4f3f-9bf6-c613ba507c5e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:29.883518 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-0608d916-cce9-4643-9249-a348f0d138d1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:29.884492 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-6416b8fd-fcb7-4f3f-9bf6-c613ba507c5e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1810 microversion: 2.20 time: 0.162829 Dec 16 15:54:29.885043 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 381/826] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:54:29 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:54:29.889804 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-50a4342f-8d27-4ff7-b0d5-60805d7e10a1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:29.890305 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-50a4342f-8d27-4ff7-b0d5-60805d7e10a1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:29.895517 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0608d916-cce9-4643-9249-a348f0d138d1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:29.896067 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0608d916-cce9-4643-9249-a348f0d138d1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:29.896924 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0608d916-cce9-4643-9249-a348f0d138d1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:29.897555 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0608d916-cce9-4643-9249-a348f0d138d1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:29.898009 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-50a4342f-8d27-4ff7-b0d5-60805d7e10a1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:29.898696 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-50a4342f-8d27-4ff7-b0d5-60805d7e10a1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:29.899474 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-50a4342f-8d27-4ff7-b0d5-60805d7e10a1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:29.899898 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-50a4342f-8d27-4ff7-b0d5-60805d7e10a1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:29.926013 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.objects.instance [None req-50a4342f-8d27-4ff7-b0d5-60805d7e10a1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lazy-loading 'flavor' on Instance uuid 248b8eac-f030-4761-a6c9-0ddaf6475f0f {{(pid=122398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:54:29.962461 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-0608d916-cce9-4643-9249-a348f0d138d1 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action" status: 200 len: 28686 microversion: 2.1 time: 0.083632 Dec 16 15:54:29.963117 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 446/827] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:54:29 2021] POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action => generated 28686 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:54:30.001750 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-50a4342f-8d27-4ff7-b0d5-60805d7e10a1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "POST /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f/action" status: 202 len: 0 microversion: 2.1 time: 0.115057 Dec 16 15:54:30.002593 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 382/828] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:54:29 2021] POST /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:54:30.011246 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-987e739e-a525-4771-9f15-9d8fd8fae761 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:30.012119 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-987e739e-a525-4771-9f15-9d8fd8fae761 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:30.019201 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-987e739e-a525-4771-9f15-9d8fd8fae761 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:30.019769 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-987e739e-a525-4771-9f15-9d8fd8fae761 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:30.020729 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-987e739e-a525-4771-9f15-9d8fd8fae761 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:30.021247 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-987e739e-a525-4771-9f15-9d8fd8fae761 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:30.159873 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-987e739e-a525-4771-9f15-9d8fd8fae761 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:30.167541 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-987e739e-a525-4771-9f15-9d8fd8fae761 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1569 microversion: 2.1 time: 0.160446 Dec 16 15:54:30.168244 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 447/829] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:30 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:30.594674 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-b5727325-e15c-4144-a19d-4c8bc2ff7894 req-5a8bd8b9-a4e0-4181-be92-134d7f9f1c75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635ee3bb-dc82-4d25-95fc-ef55d01f0705", "name": "network-vif-plugged", "status": "completed", "tag": "d48abd91-ed3c-4f04-8767-5e6f0211d6fe"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:30.596562 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:54:30.596562 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:54:30.604330 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-b5727325-e15c-4144-a19d-4c8bc2ff7894 req-5a8bd8b9-a4e0-4181-be92-134d7f9f1c75 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:30.604966 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-b5727325-e15c-4144-a19d-4c8bc2ff7894 req-5a8bd8b9-a4e0-4181-be92-134d7f9f1c75 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:30.616810 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-b5727325-e15c-4144-a19d-4c8bc2ff7894 req-5a8bd8b9-a4e0-4181-be92-134d7f9f1c75 service nova] Creating event network-vif-plugged:d48abd91-ed3c-4f04-8767-5e6f0211d6fe for instance 635ee3bb-dc82-4d25-95fc-ef55d01f0705 on hv-cinder-78447 Dec 16 15:54:30.623584 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-b5727325-e15c-4144-a19d-4c8bc2ff7894 req-5a8bd8b9-a4e0-4181-be92-134d7f9f1c75 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108536 Dec 16 15:54:30.624703 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 383/830] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:54:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:54:30.736437 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-ae4ea49e-40b0-4ab6-b457-8e9b9b2c4c76 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:30.737657 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-ae4ea49e-40b0-4ab6-b457-8e9b9b2c4c76 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: f8a79670-40b7-4b24-8484-e97517721494] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:30.737936 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-ead34a63-3734-4990-abd1-4e45605a8f88 req-9b45e722-f08f-4129-912e-62b2ed9e44ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8a79670-40b7-4b24-8484-e97517721494", "tag": "6ed2a710-c869-4081-8193-d34b97960b0f"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:30.739692 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:54:30.739692 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:54:30.746868 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ae4ea49e-40b0-4ab6-b457-8e9b9b2c4c76 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:30.747784 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ae4ea49e-40b0-4ab6-b457-8e9b9b2c4c76 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:30.748530 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-ead34a63-3734-4990-abd1-4e45605a8f88 req-9b45e722-f08f-4129-912e-62b2ed9e44ef service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:30.748678 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ae4ea49e-40b0-4ab6-b457-8e9b9b2c4c76 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:30.749156 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-ead34a63-3734-4990-abd1-4e45605a8f88 req-9b45e722-f08f-4129-912e-62b2ed9e44ef service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:30.749311 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ae4ea49e-40b0-4ab6-b457-8e9b9b2c4c76 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:30.761798 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-ead34a63-3734-4990-abd1-4e45605a8f88 req-9b45e722-f08f-4129-912e-62b2ed9e44ef service nova] Creating event network-changed:6ed2a710-c869-4081-8193-d34b97960b0f for instance f8a79670-40b7-4b24-8484-e97517721494 on hv-cinder-78447 Dec 16 15:54:30.766841 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-ead34a63-3734-4990-abd1-4e45605a8f88 req-9b45e722-f08f-4129-912e-62b2ed9e44ef service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035187 Dec 16 15:54:30.767536 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 448/831] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:54:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:54:30.883466 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-ae4ea49e-40b0-4ab6-b457-8e9b9b2c4c76 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:30.890796 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-ae4ea49e-40b0-4ab6-b457-8e9b9b2c4c76 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494" status: 200 len: 1318 microversion: 2.1 time: 0.158913 Dec 16 15:54:30.891392 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 384/832] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:30 2021] GET /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:30.904011 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-f32c3f87-3f86-4834-b934-278a192ed8fc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:30.904710 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-f32c3f87-3f86-4834-b934-278a192ed8fc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:30.910830 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f32c3f87-3f86-4834-b934-278a192ed8fc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:30.911288 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f32c3f87-3f86-4834-b934-278a192ed8fc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:30.912060 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f32c3f87-3f86-4834-b934-278a192ed8fc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:30.912490 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f32c3f87-3f86-4834-b934-278a192ed8fc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:30.975887 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-26d73955-1a9b-4d1b-8b43-5b587e564133 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:30.977290 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-26d73955-1a9b-4d1b-8b43-5b587e564133 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:30.984981 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-26d73955-1a9b-4d1b-8b43-5b587e564133 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:30.985448 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-26d73955-1a9b-4d1b-8b43-5b587e564133 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:30.986236 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-26d73955-1a9b-4d1b-8b43-5b587e564133 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:30.986684 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-26d73955-1a9b-4d1b-8b43-5b587e564133 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:31.059183 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-26d73955-1a9b-4d1b-8b43-5b587e564133 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action" status: 200 len: 28686 microversion: 2.1 time: 0.088188 Dec 16 15:54:31.059851 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 385/833] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:54:30 2021] POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action => generated 28686 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:54:31.073251 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-f32c3f87-3f86-4834-b934-278a192ed8fc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:31.082140 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-f32c3f87-3f86-4834-b934-278a192ed8fc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:31.083624 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-f32c3f87-3f86-4834-b934-278a192ed8fc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:31.084845 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-f32c3f87-3f86-4834-b934-278a192ed8fc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1810 microversion: 2.20 time: 0.185523 Dec 16 15:54:31.085435 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 449/834] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:54:30 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1810 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:54:31.185142 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-7f470ed7-3a14-4018-ac2a-b2df5882a1d7 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:31.185899 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-7f470ed7-3a14-4018-ac2a-b2df5882a1d7 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:31.193006 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7f470ed7-3a14-4018-ac2a-b2df5882a1d7 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:31.193695 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7f470ed7-3a14-4018-ac2a-b2df5882a1d7 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:31.194473 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7f470ed7-3a14-4018-ac2a-b2df5882a1d7 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:31.194908 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7f470ed7-3a14-4018-ac2a-b2df5882a1d7 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:31.328487 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-7f470ed7-3a14-4018-ac2a-b2df5882a1d7 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:31.339292 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-7f470ed7-3a14-4018-ac2a-b2df5882a1d7 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1569 microversion: 2.1 time: 0.158030 Dec 16 15:54:31.339993 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 386/835] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:31 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:31.907636 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-f870918c-e740-4647-b150-0913044bb770 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:31.908229 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-f870918c-e740-4647-b150-0913044bb770 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: f8a79670-40b7-4b24-8484-e97517721494] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:31.914902 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f870918c-e740-4647-b150-0913044bb770 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:31.915499 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f870918c-e740-4647-b150-0913044bb770 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:31.916277 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f870918c-e740-4647-b150-0913044bb770 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:31.916700 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f870918c-e740-4647-b150-0913044bb770 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:32.054294 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-f870918c-e740-4647-b150-0913044bb770 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:32.062110 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-f870918c-e740-4647-b150-0913044bb770 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494" status: 200 len: 1318 microversion: 2.1 time: 0.158308 Dec 16 15:54:32.062673 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 450/836] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:31 2021] GET /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:32.071016 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-1822f21c-806e-4006-9e78-9e0c0cdba747 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:32.071929 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-1822f21c-806e-4006-9e78-9e0c0cdba747 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:32.078582 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1822f21c-806e-4006-9e78-9e0c0cdba747 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:32.079028 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1822f21c-806e-4006-9e78-9e0c0cdba747 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:32.079796 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1822f21c-806e-4006-9e78-9e0c0cdba747 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:32.080219 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1822f21c-806e-4006-9e78-9e0c0cdba747 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:32.103406 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-20dfa20d-10bb-42a4-904d-39c316841c8d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:32.104016 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-20dfa20d-10bb-42a4-904d-39c316841c8d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:32.110167 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-20dfa20d-10bb-42a4-904d-39c316841c8d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:32.110615 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-20dfa20d-10bb-42a4-904d-39c316841c8d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:32.111396 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-20dfa20d-10bb-42a4-904d-39c316841c8d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:32.111829 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-20dfa20d-10bb-42a4-904d-39c316841c8d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:32.162459 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-1822f21c-806e-4006-9e78-9e0c0cdba747 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action" status: 200 len: 28686 microversion: 2.1 time: 0.094909 Dec 16 15:54:32.163109 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 387/837] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:54:32 2021] POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action => generated 28686 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:54:32.253391 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-20dfa20d-10bb-42a4-904d-39c316841c8d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:32.261709 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-20dfa20d-10bb-42a4-904d-39c316841c8d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:32.263177 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-20dfa20d-10bb-42a4-904d-39c316841c8d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:32.264328 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-20dfa20d-10bb-42a4-904d-39c316841c8d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1810 microversion: 2.20 time: 0.164736 Dec 16 15:54:32.264923 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 451/838] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:54:32 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:54:32.362613 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-0c0c0891-9153-42e0-b320-9edf50735aad tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:32.363940 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-0c0c0891-9153-42e0-b320-9edf50735aad tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:32.372571 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0c0c0891-9153-42e0-b320-9edf50735aad tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:32.373022 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0c0c0891-9153-42e0-b320-9edf50735aad tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:32.373851 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0c0c0891-9153-42e0-b320-9edf50735aad tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:32.374286 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0c0c0891-9153-42e0-b320-9edf50735aad tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:32.514632 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-0c0c0891-9153-42e0-b320-9edf50735aad tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:32.522006 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-0c0c0891-9153-42e0-b320-9edf50735aad tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1569 microversion: 2.1 time: 0.167212 Dec 16 15:54:32.522573 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 388/839] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:32 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:33.082890 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-39339a2e-dce4-4e74-a58c-21cd145c86e3 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:33.083822 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-39339a2e-dce4-4e74-a58c-21cd145c86e3 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: f8a79670-40b7-4b24-8484-e97517721494] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:33.091790 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-39339a2e-dce4-4e74-a58c-21cd145c86e3 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:33.092242 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-39339a2e-dce4-4e74-a58c-21cd145c86e3 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:33.093029 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-39339a2e-dce4-4e74-a58c-21cd145c86e3 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:33.093502 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-39339a2e-dce4-4e74-a58c-21cd145c86e3 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:33.174797 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-f258f03a-6855-462d-afd9-a2b9094aebe2 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:33.175791 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-f258f03a-6855-462d-afd9-a2b9094aebe2 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:33.183268 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f258f03a-6855-462d-afd9-a2b9094aebe2 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:33.183717 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f258f03a-6855-462d-afd9-a2b9094aebe2 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:33.184490 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f258f03a-6855-462d-afd9-a2b9094aebe2 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:33.184953 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f258f03a-6855-462d-afd9-a2b9094aebe2 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:33.227402 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-39339a2e-dce4-4e74-a58c-21cd145c86e3 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:33.234653 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-39339a2e-dce4-4e74-a58c-21cd145c86e3 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494" status: 200 len: 1318 microversion: 2.1 time: 0.158100 Dec 16 15:54:33.235217 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 452/840] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:33 2021] GET /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:33.273919 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-f258f03a-6855-462d-afd9-a2b9094aebe2 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action" status: 200 len: 29279 microversion: 2.1 time: 0.102577 Dec 16 15:54:33.274938 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 389/841] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:54:33 2021] POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action => generated 29279 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:54:33.289654 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-38979702-bc92-424e-ba33-d1cf58efa933 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:33.290263 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-38979702-bc92-424e-ba33-d1cf58efa933 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:33.296460 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-38979702-bc92-424e-ba33-d1cf58efa933 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:33.296904 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-38979702-bc92-424e-ba33-d1cf58efa933 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:33.297719 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-38979702-bc92-424e-ba33-d1cf58efa933 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:33.298146 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-38979702-bc92-424e-ba33-d1cf58efa933 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:33.427063 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-38979702-bc92-424e-ba33-d1cf58efa933 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:33.435322 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-38979702-bc92-424e-ba33-d1cf58efa933 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:33.436805 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-38979702-bc92-424e-ba33-d1cf58efa933 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:33.438008 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-38979702-bc92-424e-ba33-d1cf58efa933 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1797 microversion: 2.20 time: 0.154513 Dec 16 15:54:33.438542 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 453/842] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:54:33 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1797 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:54:33.539322 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-3eba1938-222d-4d62-8f30-ba42902f30e6 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:33.540017 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-3eba1938-222d-4d62-8f30-ba42902f30e6 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:33.547147 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3eba1938-222d-4d62-8f30-ba42902f30e6 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:33.547592 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3eba1938-222d-4d62-8f30-ba42902f30e6 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:33.548354 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3eba1938-222d-4d62-8f30-ba42902f30e6 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:33.548779 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3eba1938-222d-4d62-8f30-ba42902f30e6 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:33.680719 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-3eba1938-222d-4d62-8f30-ba42902f30e6 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:33.689145 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-3eba1938-222d-4d62-8f30-ba42902f30e6 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1569 microversion: 2.1 time: 0.153933 Dec 16 15:54:33.689747 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 390/843] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:33 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:34.255118 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-947a705c-2d2f-464f-90f8-3d7da080ce62 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:34.256105 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-947a705c-2d2f-464f-90f8-3d7da080ce62 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: f8a79670-40b7-4b24-8484-e97517721494] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:34.264229 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-947a705c-2d2f-464f-90f8-3d7da080ce62 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:34.264737 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-947a705c-2d2f-464f-90f8-3d7da080ce62 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:34.265657 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-947a705c-2d2f-464f-90f8-3d7da080ce62 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:34.266141 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-947a705c-2d2f-464f-90f8-3d7da080ce62 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:34.288777 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-1ed3661d-4033-410d-99f6-a2a396158880 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:34.289885 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-1ed3661d-4033-410d-99f6-a2a396158880 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:34.296579 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1ed3661d-4033-410d-99f6-a2a396158880 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:34.297070 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1ed3661d-4033-410d-99f6-a2a396158880 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:34.297887 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1ed3661d-4033-410d-99f6-a2a396158880 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:34.298286 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1ed3661d-4033-410d-99f6-a2a396158880 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:34.378576 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-1ed3661d-4033-410d-99f6-a2a396158880 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action" status: 200 len: 30992 microversion: 2.1 time: 0.093462 Dec 16 15:54:34.379309 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 391/844] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:54:34 2021] POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action => generated 30992 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:54:34.405305 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-947a705c-2d2f-464f-90f8-3d7da080ce62 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:34.413097 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-947a705c-2d2f-464f-90f8-3d7da080ce62 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494" status: 200 len: 1318 microversion: 2.1 time: 0.164073 Dec 16 15:54:34.413742 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 454/845] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:34 2021] GET /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:34.710317 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-482fc00e-c001-413a-ae7f-ef646e10eb35 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:34.711459 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-482fc00e-c001-413a-ae7f-ef646e10eb35 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:34.718664 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-482fc00e-c001-413a-ae7f-ef646e10eb35 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:34.719107 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-482fc00e-c001-413a-ae7f-ef646e10eb35 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:34.719886 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-482fc00e-c001-413a-ae7f-ef646e10eb35 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:34.720627 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-482fc00e-c001-413a-ae7f-ef646e10eb35 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:34.869466 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-482fc00e-c001-413a-ae7f-ef646e10eb35 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:34.877153 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-482fc00e-c001-413a-ae7f-ef646e10eb35 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1569 microversion: 2.1 time: 0.173165 Dec 16 15:54:34.877658 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 392/846] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:34 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:35.394908 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-36878ad5-213a-4275-8b38-ff4e18edcf3f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:35.396385 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-36878ad5-213a-4275-8b38-ff4e18edcf3f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:35.404054 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-36878ad5-213a-4275-8b38-ff4e18edcf3f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:35.404507 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-36878ad5-213a-4275-8b38-ff4e18edcf3f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:35.405297 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-36878ad5-213a-4275-8b38-ff4e18edcf3f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:35.405762 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-36878ad5-213a-4275-8b38-ff4e18edcf3f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:35.430015 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-b44a85f1-3af0-468e-afc8-30fe0d5ac32f tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:35.430593 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-b44a85f1-3af0-468e-afc8-30fe0d5ac32f tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: f8a79670-40b7-4b24-8484-e97517721494] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:35.437010 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b44a85f1-3af0-468e-afc8-30fe0d5ac32f tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:35.437480 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b44a85f1-3af0-468e-afc8-30fe0d5ac32f tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:35.438267 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b44a85f1-3af0-468e-afc8-30fe0d5ac32f tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:35.438694 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b44a85f1-3af0-468e-afc8-30fe0d5ac32f tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:35.492790 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-36878ad5-213a-4275-8b38-ff4e18edcf3f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action" status: 200 len: 32406 microversion: 2.1 time: 0.104110 Dec 16 15:54:35.493475 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 455/847] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:54:35 2021] POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action => generated 32406 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:54:35.576072 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-b44a85f1-3af0-468e-afc8-30fe0d5ac32f tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:35.583718 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-b44a85f1-3af0-468e-afc8-30fe0d5ac32f tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494" status: 200 len: 1318 microversion: 2.1 time: 0.157481 Dec 16 15:54:35.584282 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 393/848] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:35 2021] GET /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:35.896515 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-eae1e530-d31f-4ce2-8815-7010bf843a3f tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:35.897453 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-eae1e530-d31f-4ce2-8815-7010bf843a3f tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:35.904942 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-eae1e530-d31f-4ce2-8815-7010bf843a3f tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:35.905394 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-eae1e530-d31f-4ce2-8815-7010bf843a3f tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:35.906203 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-eae1e530-d31f-4ce2-8815-7010bf843a3f tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:35.906634 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-eae1e530-d31f-4ce2-8815-7010bf843a3f tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:36.039331 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-eae1e530-d31f-4ce2-8815-7010bf843a3f tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:36.048385 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-eae1e530-d31f-4ce2-8815-7010bf843a3f tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1569 microversion: 2.1 time: 0.157023 Dec 16 15:54:36.048949 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 456/849] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:35 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:36.505673 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-1efed25c-098e-4aff-9609-f69e48355a65 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:36.506584 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-1efed25c-098e-4aff-9609-f69e48355a65 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:36.512849 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1efed25c-098e-4aff-9609-f69e48355a65 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:36.513288 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1efed25c-098e-4aff-9609-f69e48355a65 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:36.514131 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1efed25c-098e-4aff-9609-f69e48355a65 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:36.514532 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1efed25c-098e-4aff-9609-f69e48355a65 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:36.573270 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-077db2b1-e888-4fb6-9c6c-0b38a57021f0 req-26d5d62c-d33e-4be0-8ac4-7011fbaccf2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8a79670-40b7-4b24-8484-e97517721494", "name": "network-vif-plugged", "status": "completed", "tag": "6ed2a710-c869-4081-8193-d34b97960b0f"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:36.575524 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:54:36.575524 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:54:36.582740 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-077db2b1-e888-4fb6-9c6c-0b38a57021f0 req-26d5d62c-d33e-4be0-8ac4-7011fbaccf2b service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:36.583172 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-077db2b1-e888-4fb6-9c6c-0b38a57021f0 req-26d5d62c-d33e-4be0-8ac4-7011fbaccf2b service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:36.589236 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-1efed25c-098e-4aff-9609-f69e48355a65 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action" status: 200 len: 33540 microversion: 2.1 time: 0.087295 Dec 16 15:54:36.590949 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 394/850] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:54:36 2021] POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action => generated 33540 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:54:36.598899 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-077db2b1-e888-4fb6-9c6c-0b38a57021f0 req-26d5d62c-d33e-4be0-8ac4-7011fbaccf2b service nova] Creating event network-vif-plugged:6ed2a710-c869-4081-8193-d34b97960b0f for instance f8a79670-40b7-4b24-8484-e97517721494 on hv-cinder-78447 Dec 16 15:54:36.601061 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-3ad84194-2b2b-4a48-afaa-4981f224f772 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:36.602387 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-3ad84194-2b2b-4a48-afaa-4981f224f772 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: f8a79670-40b7-4b24-8484-e97517721494] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:36.605024 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-077db2b1-e888-4fb6-9c6c-0b38a57021f0 req-26d5d62c-d33e-4be0-8ac4-7011fbaccf2b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035448 Dec 16 15:54:36.605646 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 457/851] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:54:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:54:36.609571 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3ad84194-2b2b-4a48-afaa-4981f224f772 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:36.610013 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3ad84194-2b2b-4a48-afaa-4981f224f772 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:36.610795 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3ad84194-2b2b-4a48-afaa-4981f224f772 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:36.611220 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3ad84194-2b2b-4a48-afaa-4981f224f772 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:36.746655 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-3ad84194-2b2b-4a48-afaa-4981f224f772 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:36.754677 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-3ad84194-2b2b-4a48-afaa-4981f224f772 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494" status: 200 len: 1318 microversion: 2.1 time: 0.157750 Dec 16 15:54:36.755241 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 395/852] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:36 2021] GET /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:37.068074 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-658cf231-94b8-4014-b9e3-a048ae0ab62e tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:37.069243 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-658cf231-94b8-4014-b9e3-a048ae0ab62e tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:37.081201 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-658cf231-94b8-4014-b9e3-a048ae0ab62e tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:37.081790 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-658cf231-94b8-4014-b9e3-a048ae0ab62e tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:37.082741 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-658cf231-94b8-4014-b9e3-a048ae0ab62e tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:37.083277 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-658cf231-94b8-4014-b9e3-a048ae0ab62e tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:37.231058 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-658cf231-94b8-4014-b9e3-a048ae0ab62e tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:37.238888 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-658cf231-94b8-4014-b9e3-a048ae0ab62e tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1569 microversion: 2.1 time: 0.176444 Dec 16 15:54:37.239495 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 458/853] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:37 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:37.605805 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-5edb861a-4efc-462e-a527-59d0d715b568 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:37.607289 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-5edb861a-4efc-462e-a527-59d0d715b568 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:37.618002 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5edb861a-4efc-462e-a527-59d0d715b568 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:37.618637 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5edb861a-4efc-462e-a527-59d0d715b568 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:37.619405 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5edb861a-4efc-462e-a527-59d0d715b568 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:37.619862 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5edb861a-4efc-462e-a527-59d0d715b568 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:37.701098 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-5edb861a-4efc-462e-a527-59d0d715b568 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action" status: 200 len: 34286 microversion: 2.1 time: 0.100945 Dec 16 15:54:37.702138 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 396/854] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:54:37 2021] POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action => generated 34286 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:54:37.774858 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-1d383aa9-b4e5-45d1-ae8b-339ab0efdf4f tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:37.775736 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-1d383aa9-b4e5-45d1-ae8b-339ab0efdf4f tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: f8a79670-40b7-4b24-8484-e97517721494] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:37.787520 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1d383aa9-b4e5-45d1-ae8b-339ab0efdf4f tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:37.788252 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1d383aa9-b4e5-45d1-ae8b-339ab0efdf4f tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:37.789635 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1d383aa9-b4e5-45d1-ae8b-339ab0efdf4f tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:37.790378 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1d383aa9-b4e5-45d1-ae8b-339ab0efdf4f tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:37.923447 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-1d383aa9-b4e5-45d1-ae8b-339ab0efdf4f tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:37.931339 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-1d383aa9-b4e5-45d1-ae8b-339ab0efdf4f tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494" status: 200 len: 1318 microversion: 2.1 time: 0.162858 Dec 16 15:54:37.931881 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 459/855] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:37 2021] GET /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:38.260542 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-d9f6d8a1-9528-4ebb-a927-210d95ae4082 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:38.261719 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-d9f6d8a1-9528-4ebb-a927-210d95ae4082 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:38.273040 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d9f6d8a1-9528-4ebb-a927-210d95ae4082 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:38.273832 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d9f6d8a1-9528-4ebb-a927-210d95ae4082 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:38.275013 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d9f6d8a1-9528-4ebb-a927-210d95ae4082 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:38.275440 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d9f6d8a1-9528-4ebb-a927-210d95ae4082 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:38.421610 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-d9f6d8a1-9528-4ebb-a927-210d95ae4082 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:38.432173 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-d9f6d8a1-9528-4ebb-a927-210d95ae4082 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1569 microversion: 2.1 time: 0.178476 Dec 16 15:54:38.432742 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 397/856] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:38 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:38.719797 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-7032e473-a33d-4430-9078-3c214a542b2a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:38.721553 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-7032e473-a33d-4430-9078-3c214a542b2a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:38.730297 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7032e473-a33d-4430-9078-3c214a542b2a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:38.730742 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7032e473-a33d-4430-9078-3c214a542b2a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:38.731504 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7032e473-a33d-4430-9078-3c214a542b2a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:38.731931 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7032e473-a33d-4430-9078-3c214a542b2a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:38.804766 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-7032e473-a33d-4430-9078-3c214a542b2a tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action" status: 200 len: 35334 microversion: 2.1 time: 0.091022 Dec 16 15:54:38.805883 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 460/857] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:54:38 2021] POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action => generated 35334 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:54:38.951983 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-7b759f67-cda3-4524-b8e8-a0b8ca64ffc3 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:38.952844 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-7b759f67-cda3-4524-b8e8-a0b8ca64ffc3 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: f8a79670-40b7-4b24-8484-e97517721494] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:38.963093 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7b759f67-cda3-4524-b8e8-a0b8ca64ffc3 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:38.963531 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7b759f67-cda3-4524-b8e8-a0b8ca64ffc3 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:38.964300 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7b759f67-cda3-4524-b8e8-a0b8ca64ffc3 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:38.964723 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7b759f67-cda3-4524-b8e8-a0b8ca64ffc3 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:39.111744 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-7b759f67-cda3-4524-b8e8-a0b8ca64ffc3 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:39.121260 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-7b759f67-cda3-4524-b8e8-a0b8ca64ffc3 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494" status: 200 len: 1507 microversion: 2.1 time: 0.175801 Dec 16 15:54:39.122266 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 398/858] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:38 2021] GET /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494 => generated 1507 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:39.138961 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-62050c4a-3a3b-4c45-8392-279ca43b8d72 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e74883f6-e9be-4bdb-94ad-9a4df32d14eb", "device": "/dev/sdb"}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:39.140164 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-62050c4a-3a3b-4c45-8392-279ca43b8d72 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: f8a79670-40b7-4b24-8484-e97517721494] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:39.147262 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-62050c4a-3a3b-4c45-8392-279ca43b8d72 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:39.147699 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-62050c4a-3a3b-4c45-8392-279ca43b8d72 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:39.148462 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-62050c4a-3a3b-4c45-8392-279ca43b8d72 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:39.148881 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-62050c4a-3a3b-4c45-8392-279ca43b8d72 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:39.405727 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-62050c4a-3a3b-4c45-8392-279ca43b8d72 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "POST /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270631 Dec 16 15:54:39.406305 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 461/859] 10.222.0.31 () {60 vars in 1322 bytes} [Thu Dec 16 15:54:39 2021] POST /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:54:39.448408 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-9cd61ec7-4644-4d59-bc39-13dbf14ea975 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:39.449168 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-9cd61ec7-4644-4d59-bc39-13dbf14ea975 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:39.462327 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9cd61ec7-4644-4d59-bc39-13dbf14ea975 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:39.462859 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9cd61ec7-4644-4d59-bc39-13dbf14ea975 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:39.463756 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9cd61ec7-4644-4d59-bc39-13dbf14ea975 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:39.464189 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9cd61ec7-4644-4d59-bc39-13dbf14ea975 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:39.602242 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-9cd61ec7-4644-4d59-bc39-13dbf14ea975 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:39.610138 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-9cd61ec7-4644-4d59-bc39-13dbf14ea975 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1569 microversion: 2.1 time: 0.165742 Dec 16 15:54:39.610722 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 399/860] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:39 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:39.820270 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-e583d95e-4e05-488c-bec6-88819520167f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:39.821375 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-e583d95e-4e05-488c-bec6-88819520167f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:39.828011 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e583d95e-4e05-488c-bec6-88819520167f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:39.828491 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e583d95e-4e05-488c-bec6-88819520167f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:39.829372 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e583d95e-4e05-488c-bec6-88819520167f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:39.829871 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e583d95e-4e05-488c-bec6-88819520167f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:39.914954 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-e583d95e-4e05-488c-bec6-88819520167f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action" status: 200 len: 36724 microversion: 2.1 time: 0.099172 Dec 16 15:54:39.915596 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 462/861] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:54:39 2021] POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action => generated 36724 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:54:40.631307 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-60df5054-1397-4d26-bf47-38180940d7eb tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:40.632310 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-60df5054-1397-4d26-bf47-38180940d7eb tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:40.642985 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-60df5054-1397-4d26-bf47-38180940d7eb tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:40.643765 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-60df5054-1397-4d26-bf47-38180940d7eb tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:40.645038 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-60df5054-1397-4d26-bf47-38180940d7eb tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:40.645794 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-60df5054-1397-4d26-bf47-38180940d7eb tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:40.777908 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-60df5054-1397-4d26-bf47-38180940d7eb tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:40.785942 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-60df5054-1397-4d26-bf47-38180940d7eb tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1569 microversion: 2.1 time: 0.160882 Dec 16 15:54:40.786514 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 400/862] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:40 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:40.931241 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-1b8e972a-351e-45a6-a177-07d2fc52e9b8 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:40.932853 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-1b8e972a-351e-45a6-a177-07d2fc52e9b8 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:40.944262 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1b8e972a-351e-45a6-a177-07d2fc52e9b8 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:40.945013 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1b8e972a-351e-45a6-a177-07d2fc52e9b8 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:40.946381 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1b8e972a-351e-45a6-a177-07d2fc52e9b8 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:40.947024 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1b8e972a-351e-45a6-a177-07d2fc52e9b8 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:41.045225 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-1b8e972a-351e-45a6-a177-07d2fc52e9b8 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action" status: 200 len: 37924 microversion: 2.1 time: 0.120630 Dec 16 15:54:41.045907 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 463/863] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:54:40 2021] POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action => generated 37924 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:54:41.806955 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-57ad5611-6a65-4f19-ab1f-592fc6d1f401 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:41.807929 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-57ad5611-6a65-4f19-ab1f-592fc6d1f401 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:41.818566 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-57ad5611-6a65-4f19-ab1f-592fc6d1f401 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:41.819302 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-57ad5611-6a65-4f19-ab1f-592fc6d1f401 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:41.820564 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-57ad5611-6a65-4f19-ab1f-592fc6d1f401 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:41.821268 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-57ad5611-6a65-4f19-ab1f-592fc6d1f401 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:41.966559 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-57ad5611-6a65-4f19-ab1f-592fc6d1f401 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:41.975078 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-57ad5611-6a65-4f19-ab1f-592fc6d1f401 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1569 microversion: 2.1 time: 0.174356 Dec 16 15:54:41.975628 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 401/864] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:41 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:42.059612 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-972d9ed3-591b-4d53-8fac-4fdfbd983d64 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:42.060531 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-972d9ed3-591b-4d53-8fac-4fdfbd983d64 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:42.067880 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-972d9ed3-591b-4d53-8fac-4fdfbd983d64 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:42.068332 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-972d9ed3-591b-4d53-8fac-4fdfbd983d64 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:42.069110 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-972d9ed3-591b-4d53-8fac-4fdfbd983d64 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:42.069584 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-972d9ed3-591b-4d53-8fac-4fdfbd983d64 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:42.152094 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-972d9ed3-591b-4d53-8fac-4fdfbd983d64 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action" status: 200 len: 38217 microversion: 2.1 time: 0.097332 Dec 16 15:54:42.152735 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 464/865] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:54:42 2021] POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action => generated 38217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:54:42.995806 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-dffae716-5242-4e5c-b10f-153affdc1152 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:42.996805 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-dffae716-5242-4e5c-b10f-153affdc1152 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:43.007461 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-dffae716-5242-4e5c-b10f-153affdc1152 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:43.008098 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-dffae716-5242-4e5c-b10f-153affdc1152 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:43.009391 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-dffae716-5242-4e5c-b10f-153affdc1152 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:43.009860 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-dffae716-5242-4e5c-b10f-153affdc1152 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:43.137389 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-dffae716-5242-4e5c-b10f-153affdc1152 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:43.145191 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-dffae716-5242-4e5c-b10f-153affdc1152 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1569 microversion: 2.1 time: 0.155567 Dec 16 15:54:43.145862 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 402/866] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:42 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:43.164828 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-a52a8aa2-cba5-4e9e-a788-24e189950107 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:43.165898 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-a52a8aa2-cba5-4e9e-a788-24e189950107 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:43.173233 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a52a8aa2-cba5-4e9e-a788-24e189950107 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:43.173721 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a52a8aa2-cba5-4e9e-a788-24e189950107 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:43.174500 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a52a8aa2-cba5-4e9e-a788-24e189950107 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:43.174933 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a52a8aa2-cba5-4e9e-a788-24e189950107 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:43.237115 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-a52a8aa2-cba5-4e9e-a788-24e189950107 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action" status: 200 len: 38217 microversion: 2.1 time: 0.076227 Dec 16 15:54:43.237760 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 465/867] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:54:43 2021] POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action => generated 38217 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:54:43.792906 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:54:43.793291 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: Thu Dec 16 15:54:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 15:54:44.167131 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-a5a08c7f-6768-426d-94d7-3f7dd4ee42a1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:44.168097 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-a5a08c7f-6768-426d-94d7-3f7dd4ee42a1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:44.178858 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a5a08c7f-6768-426d-94d7-3f7dd4ee42a1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:44.179592 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a5a08c7f-6768-426d-94d7-3f7dd4ee42a1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:44.180962 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a5a08c7f-6768-426d-94d7-3f7dd4ee42a1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:44.181525 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a5a08c7f-6768-426d-94d7-3f7dd4ee42a1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:44.249686 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-d0de18bd-2b97-4644-ad03-70b08060c287 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:44.250691 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-d0de18bd-2b97-4644-ad03-70b08060c287 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:44.257740 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d0de18bd-2b97-4644-ad03-70b08060c287 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:44.258190 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d0de18bd-2b97-4644-ad03-70b08060c287 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:44.258968 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d0de18bd-2b97-4644-ad03-70b08060c287 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:44.259401 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d0de18bd-2b97-4644-ad03-70b08060c287 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:44.318755 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-a5a08c7f-6768-426d-94d7-3f7dd4ee42a1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:44.326061 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-a5a08c7f-6768-426d-94d7-3f7dd4ee42a1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1569 microversion: 2.1 time: 0.165103 Dec 16 15:54:44.326640 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 403/868] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:44 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:44.336409 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-d0de18bd-2b97-4644-ad03-70b08060c287 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action" status: 200 len: 38217 microversion: 2.1 time: 0.090702 Dec 16 15:54:44.337133 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 466/869] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:54:44 2021] POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action => generated 38217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 15:54:45.343443 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-62123bce-29d4-4af2-89fc-63db901f5054 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:45.344127 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-62123bce-29d4-4af2-89fc-63db901f5054 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:45.349123 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-868d59a8-f2d2-4761-b1f6-61388ade5054 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:45.350317 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-868d59a8-f2d2-4761-b1f6-61388ade5054 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:45.350878 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-62123bce-29d4-4af2-89fc-63db901f5054 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:45.351331 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-62123bce-29d4-4af2-89fc-63db901f5054 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:45.352115 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-62123bce-29d4-4af2-89fc-63db901f5054 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:45.352545 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-62123bce-29d4-4af2-89fc-63db901f5054 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:45.357453 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-868d59a8-f2d2-4761-b1f6-61388ade5054 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:45.357911 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-868d59a8-f2d2-4761-b1f6-61388ade5054 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:45.358688 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-868d59a8-f2d2-4761-b1f6-61388ade5054 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:45.359107 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-868d59a8-f2d2-4761-b1f6-61388ade5054 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:45.435761 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-868d59a8-f2d2-4761-b1f6-61388ade5054 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action" status: 200 len: 38348 microversion: 2.1 time: 0.090836 Dec 16 15:54:45.436700 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 467/870] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:54:45 2021] POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/action => generated 38348 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:54:45.446963 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-6dbc8d9f-e33b-4f10-a32e-8c9093f91fef tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:45.447812 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-6dbc8d9f-e33b-4f10-a32e-8c9093f91fef tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:45.457362 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6dbc8d9f-e33b-4f10-a32e-8c9093f91fef tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:45.458392 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6dbc8d9f-e33b-4f10-a32e-8c9093f91fef tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:45.459520 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6dbc8d9f-e33b-4f10-a32e-8c9093f91fef tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:45.460238 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6dbc8d9f-e33b-4f10-a32e-8c9093f91fef tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:45.490759 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-6dbc8d9f-e33b-4f10-a32e-8c9093f91fef tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/ips" status: 200 len: 146 microversion: 2.1 time: 0.046999 Dec 16 15:54:45.491419 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 468/871] 10.222.0.31 () {58 vars in 1247 bytes} [Thu Dec 16 15:54:45 2021] GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/ips => generated 146 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:54:45.555783 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-62123bce-29d4-4af2-89fc-63db901f5054 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:45.563613 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-62123bce-29d4-4af2-89fc-63db901f5054 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1569 microversion: 2.1 time: 0.223906 Dec 16 15:54:45.564199 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 404/872] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:45 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:46.584763 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-83feb433-8d56-48ae-8749-881b42b9c395 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:46.585805 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-83feb433-8d56-48ae-8749-881b42b9c395 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:46.593810 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-83feb433-8d56-48ae-8749-881b42b9c395 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:46.594344 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-83feb433-8d56-48ae-8749-881b42b9c395 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:46.595524 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-83feb433-8d56-48ae-8749-881b42b9c395 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:46.596008 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-83feb433-8d56-48ae-8749-881b42b9c395 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:46.731680 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-83feb433-8d56-48ae-8749-881b42b9c395 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:46.739725 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-83feb433-8d56-48ae-8749-881b42b9c395 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1569 microversion: 2.1 time: 0.161186 Dec 16 15:54:46.740291 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 469/873] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:46 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:46.815936 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-5681f585-49b5-4d63-a4be-7a906294b770 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54fb86fb-1aae-4df8-8fbc-94089285b129"}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:46.816995 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-5681f585-49b5-4d63-a4be-7a906294b770 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:46.823299 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5681f585-49b5-4d63-a4be-7a906294b770 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:46.824003 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5681f585-49b5-4d63-a4be-7a906294b770 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:46.824792 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5681f585-49b5-4d63-a4be-7a906294b770 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:46.825228 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5681f585-49b5-4d63-a4be-7a906294b770 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:47.075654 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-5681f585-49b5-4d63-a4be-7a906294b770 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263325 Dec 16 15:54:47.076445 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 405/874] 10.222.0.31 () {60 vars in 1322 bytes} [Thu Dec 16 15:54:46 2021] POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:54:47.760448 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-39b0698d-5bd3-4586-b3aa-97977bfc4bc1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:47.761146 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-39b0698d-5bd3-4586-b3aa-97977bfc4bc1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:47.769823 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-39b0698d-5bd3-4586-b3aa-97977bfc4bc1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:47.770411 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-39b0698d-5bd3-4586-b3aa-97977bfc4bc1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:47.771438 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-39b0698d-5bd3-4586-b3aa-97977bfc4bc1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:47.772010 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-39b0698d-5bd3-4586-b3aa-97977bfc4bc1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:48.167577 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-39b0698d-5bd3-4586-b3aa-97977bfc4bc1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:48.174978 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-39b0698d-5bd3-4586-b3aa-97977bfc4bc1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1569 microversion: 2.1 time: 0.420536 Dec 16 15:54:48.175571 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 470/875] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:47 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1569 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:49.195645 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-6f6196ce-c6d3-40b0-baa7-109c8d55ef8c tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:49.197050 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-6f6196ce-c6d3-40b0-baa7-109c8d55ef8c tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:49.204089 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6f6196ce-c6d3-40b0-baa7-109c8d55ef8c tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:49.204667 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6f6196ce-c6d3-40b0-baa7-109c8d55ef8c tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:49.205593 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6f6196ce-c6d3-40b0-baa7-109c8d55ef8c tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:49.206091 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6f6196ce-c6d3-40b0-baa7-109c8d55ef8c tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:49.351727 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-6f6196ce-c6d3-40b0-baa7-109c8d55ef8c tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:49.359314 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-6f6196ce-c6d3-40b0-baa7-109c8d55ef8c tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1569 microversion: 2.1 time: 0.170806 Dec 16 15:54:49.359891 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 406/876] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:49 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:50.208413 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-97abfce2-d835-44b3-ab27-5ee09b6b21d6 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:50.209313 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-97abfce2-d835-44b3-ab27-5ee09b6b21d6 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: d87f6b70-6ea0-48c1-b18c-59052e3ff9d3] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:50.218413 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-97abfce2-d835-44b3-ab27-5ee09b6b21d6 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:50.218860 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-97abfce2-d835-44b3-ab27-5ee09b6b21d6 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:50.219645 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-97abfce2-d835-44b3-ab27-5ee09b6b21d6 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:50.220436 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-97abfce2-d835-44b3-ab27-5ee09b6b21d6 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:50.246249 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-97abfce2-d835-44b3-ab27-5ee09b6b21d6 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: d87f6b70-6ea0-48c1-b18c-59052e3ff9d3] Going to try to terminate instance {{(pid=122399) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 15:54:50.324928 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-97abfce2-d835-44b3-ab27-5ee09b6b21d6 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "DELETE /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3" status: 204 len: 0 microversion: 2.1 time: 0.122368 Dec 16 15:54:50.325636 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 471/877] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Dec 16 15:54:50 2021] DELETE /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:54:50.333598 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-4222d56e-26ce-4ded-a975-d1bcce4ed097 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:50.334187 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-4222d56e-26ce-4ded-a975-d1bcce4ed097 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: d87f6b70-6ea0-48c1-b18c-59052e3ff9d3] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:50.340855 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4222d56e-26ce-4ded-a975-d1bcce4ed097 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:50.341210 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4222d56e-26ce-4ded-a975-d1bcce4ed097 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:50.342010 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4222d56e-26ce-4ded-a975-d1bcce4ed097 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:50.342433 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4222d56e-26ce-4ded-a975-d1bcce4ed097 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:50.376378 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-5d88c21e-a6c6-4ca6-8cef-ac18d986ae9f tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:50.377170 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-5d88c21e-a6c6-4ca6-8cef-ac18d986ae9f tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:50.383195 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5d88c21e-a6c6-4ca6-8cef-ac18d986ae9f tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:50.383655 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5d88c21e-a6c6-4ca6-8cef-ac18d986ae9f tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:50.384447 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5d88c21e-a6c6-4ca6-8cef-ac18d986ae9f tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:50.384885 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5d88c21e-a6c6-4ca6-8cef-ac18d986ae9f tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:50.642751 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-4222d56e-26ce-4ded-a975-d1bcce4ed097 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:50.650454 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-4222d56e-26ce-4ded-a975-d1bcce4ed097 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3" status: 200 len: 1575 microversion: 2.1 time: 0.320477 Dec 16 15:54:50.651115 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 407/878] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:50 2021] GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 => generated 1575 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:50.664719 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-5d88c21e-a6c6-4ca6-8cef-ac18d986ae9f tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:50.672159 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-5d88c21e-a6c6-4ca6-8cef-ac18d986ae9f tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1569 microversion: 2.1 time: 0.299790 Dec 16 15:54:50.672720 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 472/879] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:50 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1569 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:51.668097 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-9b16a7ad-dc5a-4312-b170-fdf16cccd399 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:51.668829 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-9b16a7ad-dc5a-4312-b170-fdf16cccd399 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: d87f6b70-6ea0-48c1-b18c-59052e3ff9d3] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:51.675685 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9b16a7ad-dc5a-4312-b170-fdf16cccd399 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:51.676138 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9b16a7ad-dc5a-4312-b170-fdf16cccd399 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:51.676910 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9b16a7ad-dc5a-4312-b170-fdf16cccd399 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:51.677343 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9b16a7ad-dc5a-4312-b170-fdf16cccd399 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:51.688702 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-faefbdda-d058-49a1-9e0f-1a966b6582b3 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:51.689428 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-faefbdda-d058-49a1-9e0f-1a966b6582b3 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:51.695978 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-faefbdda-d058-49a1-9e0f-1a966b6582b3 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:51.696427 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-faefbdda-d058-49a1-9e0f-1a966b6582b3 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:51.697208 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-faefbdda-d058-49a1-9e0f-1a966b6582b3 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:51.697676 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-faefbdda-d058-49a1-9e0f-1a966b6582b3 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:51.872780 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-9b16a7ad-dc5a-4312-b170-fdf16cccd399 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:51.880861 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-9b16a7ad-dc5a-4312-b170-fdf16cccd399 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3" status: 200 len: 1575 microversion: 2.1 time: 0.216618 Dec 16 15:54:51.881030 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-faefbdda-d058-49a1-9e0f-1a966b6582b3 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:51.881438 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 408/880] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:51 2021] GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 => generated 1575 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:51.888897 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-faefbdda-d058-49a1-9e0f-1a966b6582b3 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1510 microversion: 2.1 time: 0.203884 Dec 16 15:54:51.889469 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 473/881] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:51 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1510 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:51.904738 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-f9405d35-b034-432c-a82e-721dc150f934 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:51.905328 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-f9405d35-b034-432c-a82e-721dc150f934 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:51.911516 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f9405d35-b034-432c-a82e-721dc150f934 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:51.911970 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f9405d35-b034-432c-a82e-721dc150f934 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:51.912740 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f9405d35-b034-432c-a82e-721dc150f934 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:51.913173 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f9405d35-b034-432c-a82e-721dc150f934 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:52.000965 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-f9405d35-b034-432c-a82e-721dc150f934 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "POST /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f/action" status: 202 len: 0 microversion: 2.1 time: 0.099643 Dec 16 15:54:52.001387 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 409/882] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:54:51 2021] POST /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:54:52.009430 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-51fe1d8f-ce03-4b3a-872d-bd36a419fb5f tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:52.010187 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-51fe1d8f-ce03-4b3a-872d-bd36a419fb5f tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:52.016435 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-51fe1d8f-ce03-4b3a-872d-bd36a419fb5f tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:52.016953 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-51fe1d8f-ce03-4b3a-872d-bd36a419fb5f tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:52.017769 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-51fe1d8f-ce03-4b3a-872d-bd36a419fb5f tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:52.018198 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-51fe1d8f-ce03-4b3a-872d-bd36a419fb5f tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:52.170328 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-51fe1d8f-ce03-4b3a-872d-bd36a419fb5f tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:52.178002 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-51fe1d8f-ce03-4b3a-872d-bd36a419fb5f tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1518 microversion: 2.1 time: 0.172170 Dec 16 15:54:52.178985 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 474/883] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:52 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1518 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:52.629854 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-403a0192-ffa2-4b59-a29a-3ee27bd64cfe req-510bb932-2a4f-4693-aa62-061652d17bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "248b8eac-f030-4761-a6c9-0ddaf6475f0f", "name": "network-vif-unplugged", "status": "completed", "tag": "8e2fdbb4-3edf-41eb-8daa-904ea54bacb1"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:52.631447 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:54:52.631447 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:54:52.638392 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-403a0192-ffa2-4b59-a29a-3ee27bd64cfe req-510bb932-2a4f-4693-aa62-061652d17bb4 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:52.638870 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-403a0192-ffa2-4b59-a29a-3ee27bd64cfe req-510bb932-2a4f-4693-aa62-061652d17bb4 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:52.651762 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.compute.server_external_events [req-403a0192-ffa2-4b59-a29a-3ee27bd64cfe req-510bb932-2a4f-4693-aa62-061652d17bb4 service nova] Unable to find a host for instance 248b8eac-f030-4761-a6c9-0ddaf6475f0f. Dropping event network-vif-unplugged {{(pid=122398) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 16 15:54:52.652645 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-403a0192-ffa2-4b59-a29a-3ee27bd64cfe req-510bb932-2a4f-4693-aa62-061652d17bb4 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026927 Dec 16 15:54:52.653221 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 410/884] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:54:52 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 16 15:54:52.901658 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-80499617-c233-4842-a491-3d6a790696e9 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:52.902548 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-80499617-c233-4842-a491-3d6a790696e9 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: d87f6b70-6ea0-48c1-b18c-59052e3ff9d3] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:52.913152 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-80499617-c233-4842-a491-3d6a790696e9 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:52.913944 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-80499617-c233-4842-a491-3d6a790696e9 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:52.915225 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-80499617-c233-4842-a491-3d6a790696e9 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:52.915970 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-80499617-c233-4842-a491-3d6a790696e9 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:53.058948 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-80499617-c233-4842-a491-3d6a790696e9 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:53.067022 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-80499617-c233-4842-a491-3d6a790696e9 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3" status: 200 len: 1575 microversion: 2.1 time: 0.171648 Dec 16 15:54:53.067578 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 475/885] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:52 2021] GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:53.199008 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-b7ec6519-9411-4265-a879-ca75c62db285 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:53.200018 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-b7ec6519-9411-4265-a879-ca75c62db285 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:53.210877 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b7ec6519-9411-4265-a879-ca75c62db285 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:53.211635 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b7ec6519-9411-4265-a879-ca75c62db285 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:53.212937 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b7ec6519-9411-4265-a879-ca75c62db285 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:53.213371 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b7ec6519-9411-4265-a879-ca75c62db285 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:53.352612 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-b7ec6519-9411-4265-a879-ca75c62db285 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:53.360038 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-b7ec6519-9411-4265-a879-ca75c62db285 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1518 microversion: 2.1 time: 0.167455 Dec 16 15:54:53.360896 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 411/886] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:53 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:54.088911 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-5a598ea0-4f1f-4ff6-ad84-22060a8b43f2 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:54.089582 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-5a598ea0-4f1f-4ff6-ad84-22060a8b43f2 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: d87f6b70-6ea0-48c1-b18c-59052e3ff9d3] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:54.096832 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5a598ea0-4f1f-4ff6-ad84-22060a8b43f2 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:54.097285 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5a598ea0-4f1f-4ff6-ad84-22060a8b43f2 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:54.098172 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5a598ea0-4f1f-4ff6-ad84-22060a8b43f2 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:54.098609 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5a598ea0-4f1f-4ff6-ad84-22060a8b43f2 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:54.235555 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-5a598ea0-4f1f-4ff6-ad84-22060a8b43f2 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:54.247055 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-5a598ea0-4f1f-4ff6-ad84-22060a8b43f2 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3" status: 200 len: 1575 microversion: 2.1 time: 0.163522 Dec 16 15:54:54.247789 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 476/887] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:54 2021] GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:54.382129 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-6dcd08ce-c20b-41a7-be67-fdd443effb97 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:54.382721 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-6dcd08ce-c20b-41a7-be67-fdd443effb97 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:54.390477 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6dcd08ce-c20b-41a7-be67-fdd443effb97 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:54.391096 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6dcd08ce-c20b-41a7-be67-fdd443effb97 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:54.391893 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6dcd08ce-c20b-41a7-be67-fdd443effb97 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:54.392326 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6dcd08ce-c20b-41a7-be67-fdd443effb97 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:54.538504 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-6dcd08ce-c20b-41a7-be67-fdd443effb97 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:54.546095 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-6dcd08ce-c20b-41a7-be67-fdd443effb97 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1518 microversion: 2.1 time: 0.170901 Dec 16 15:54:54.546637 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 412/888] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:54 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1518 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:55.264170 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-5130c800-72ad-4d3f-a974-3a5470d38c8c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:55.264722 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-5130c800-72ad-4d3f-a974-3a5470d38c8c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: d87f6b70-6ea0-48c1-b18c-59052e3ff9d3] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:55.271261 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5130c800-72ad-4d3f-a974-3a5470d38c8c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:55.271708 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5130c800-72ad-4d3f-a974-3a5470d38c8c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:55.272478 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5130c800-72ad-4d3f-a974-3a5470d38c8c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:55.272902 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5130c800-72ad-4d3f-a974-3a5470d38c8c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:55.531229 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-5130c800-72ad-4d3f-a974-3a5470d38c8c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:55.539065 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-5130c800-72ad-4d3f-a974-3a5470d38c8c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3" status: 200 len: 1575 microversion: 2.1 time: 0.278713 Dec 16 15:54:55.539943 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 477/889] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:55 2021] GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 => generated 1575 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:55.564114 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-5d220b44-7c24-436f-bdfe-9d0926473c8d tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:55.564857 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-5d220b44-7c24-436f-bdfe-9d0926473c8d tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:55.571236 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5d220b44-7c24-436f-bdfe-9d0926473c8d tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:55.571691 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5d220b44-7c24-436f-bdfe-9d0926473c8d tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:55.572454 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5d220b44-7c24-436f-bdfe-9d0926473c8d tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:55.572878 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5d220b44-7c24-436f-bdfe-9d0926473c8d tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:55.790902 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-5d220b44-7c24-436f-bdfe-9d0926473c8d tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:55.798825 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-5d220b44-7c24-436f-bdfe-9d0926473c8d tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1520 microversion: 2.1 time: 0.240178 Dec 16 15:54:55.799414 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 413/890] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:55 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:56.168862 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-0ff27244-6491-4a3c-b3f1-ad1086c2d004 req-327d3f3f-9620-4768-87be-f1c3893799d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d87f6b70-6ea0-48c1-b18c-59052e3ff9d3", "name": "network-vif-deleted", "tag": "41774a69-3e6e-4cb8-a2ce-3f35fab82c16"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:56.170512 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:54:56.170512 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:54:56.177566 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-0ff27244-6491-4a3c-b3f1-ad1086c2d004 req-327d3f3f-9620-4768-87be-f1c3893799d4 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:56.178016 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-0ff27244-6491-4a3c-b3f1-ad1086c2d004 req-327d3f3f-9620-4768-87be-f1c3893799d4 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:56.190752 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-0ff27244-6491-4a3c-b3f1-ad1086c2d004 req-327d3f3f-9620-4768-87be-f1c3893799d4 service nova] Creating event network-vif-deleted:41774a69-3e6e-4cb8-a2ce-3f35fab82c16 for instance d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 on hv-cinder-78447 Dec 16 15:54:56.196078 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-0ff27244-6491-4a3c-b3f1-ad1086c2d004 req-327d3f3f-9620-4768-87be-f1c3893799d4 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091445 Dec 16 15:54:56.197464 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 478/891] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:54:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:54:56.555882 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-d0118000-c315-4242-8b75-29b8d43d9353 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:56.556514 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-d0118000-c315-4242-8b75-29b8d43d9353 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: d87f6b70-6ea0-48c1-b18c-59052e3ff9d3] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:56.563862 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d0118000-c315-4242-8b75-29b8d43d9353 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:56.564297 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d0118000-c315-4242-8b75-29b8d43d9353 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:56.565713 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d0118000-c315-4242-8b75-29b8d43d9353 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:56.566319 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d0118000-c315-4242-8b75-29b8d43d9353 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:56.604921 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d0118000-c315-4242-8b75-29b8d43d9353 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:56.605362 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d0118000-c315-4242-8b75-29b8d43d9353 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:56.605922 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.objects.instance [None req-d0118000-c315-4242-8b75-29b8d43d9353 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lazy-loading 'fault' on Instance uuid d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 {{(pid=122398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:54:56.655363 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-d0118000-c315-4242-8b75-29b8d43d9353 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:56.662817 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-d0118000-c315-4242-8b75-29b8d43d9353 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3" status: 200 len: 1230 microversion: 2.1 time: 0.110655 Dec 16 15:54:56.663394 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 414/892] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:56 2021] GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 => generated 1230 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:56.816666 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-18de7da1-a711-49be-a3f6-2fb5ab0efcde tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:56.817513 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-18de7da1-a711-49be-a3f6-2fb5ab0efcde tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:56.824829 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-18de7da1-a711-49be-a3f6-2fb5ab0efcde tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:56.825461 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-18de7da1-a711-49be-a3f6-2fb5ab0efcde tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:56.826649 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-18de7da1-a711-49be-a3f6-2fb5ab0efcde tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:56.827280 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-18de7da1-a711-49be-a3f6-2fb5ab0efcde tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:57.002576 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-18de7da1-a711-49be-a3f6-2fb5ab0efcde tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:57.014570 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-18de7da1-a711-49be-a3f6-2fb5ab0efcde tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1520 microversion: 2.1 time: 0.202171 Dec 16 15:54:57.015719 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 479/893] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:56 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:57.686874 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-bebeefb5-754e-4e08-97ae-8db59bebe1ba tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:57.687558 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-bebeefb5-754e-4e08-97ae-8db59bebe1ba tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: d87f6b70-6ea0-48c1-b18c-59052e3ff9d3] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:57.695313 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-bebeefb5-754e-4e08-97ae-8db59bebe1ba tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:57.695755 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-bebeefb5-754e-4e08-97ae-8db59bebe1ba tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:57.696525 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-bebeefb5-754e-4e08-97ae-8db59bebe1ba tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:57.696969 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-bebeefb5-754e-4e08-97ae-8db59bebe1ba tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:57.712059 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.wsgi [None req-bebeefb5-754e-4e08-97ae-8db59bebe1ba tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] HTTP exception thrown: Instance d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 could not be found. Dec 16 15:54:57.712568 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-bebeefb5-754e-4e08-97ae-8db59bebe1ba tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Returning 404 to user: Instance d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 could not be found. {{(pid=122398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:54:57.713744 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-bebeefb5-754e-4e08-97ae-8db59bebe1ba tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3" status: 404 len: 111 microversion: 2.1 time: 0.030582 Dec 16 15:54:57.714447 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 415/894] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:57 2021] GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:54:57.750237 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-73936bf2-0737-4df0-88c8-04d013e459a4 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:57.751328 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-73936bf2-0737-4df0-88c8-04d013e459a4 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:57.757650 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-73936bf2-0737-4df0-88c8-04d013e459a4 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:57.758102 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-73936bf2-0737-4df0-88c8-04d013e459a4 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:57.758888 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-73936bf2-0737-4df0-88c8-04d013e459a4 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:57.759317 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-73936bf2-0737-4df0-88c8-04d013e459a4 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:57.787933 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-73936bf2-0737-4df0-88c8-04d013e459a4 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041834 Dec 16 15:54:57.788591 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 480/895] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Dec 16 15:54:57 2021] GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:54:57.798361 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-4f262763-ed53-46ee-b2b4-24bf531881e6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:57.798841 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-4f262763-ed53-46ee-b2b4-24bf531881e6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:57.804588 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4f262763-ed53-46ee-b2b4-24bf531881e6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:57.805029 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4f262763-ed53-46ee-b2b4-24bf531881e6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:57.805835 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4f262763-ed53-46ee-b2b4-24bf531881e6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:57.806257 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4f262763-ed53-46ee-b2b4-24bf531881e6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:57.808750 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-2f4d6248-c39c-49f0-a7f3-c08cc3f9b638 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1634405796", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-824262971", "security_groups": [{"name": "tempest-secgroup-smoke-832002217"}], "block_device_mapping_v2": [{"uuid": "0cc0d22d-8207-477e-9b77-bb3e8363f503", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "447cd8ca-a758-4b0d-966f-d4641376c8a8"}]}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:57.835451 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-4f262763-ed53-46ee-b2b4-24bf531881e6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/os-volume_attachments/54fb86fb-1aae-4df8-8fbc-94089285b129" status: 200 len: 194 microversion: 2.1 time: 0.040891 Dec 16 15:54:57.836065 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 416/896] 10.222.0.31 () {58 vars in 1412 bytes} [Thu Dec 16 15:54:57 2021] GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/os-volume_attachments/54fb86fb-1aae-4df8-8fbc-94089285b129 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:54:57.927034 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.network.neutron [None req-2f4d6248-c39c-49f0-a7f3-c08cc3f9b638 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] validate_networks() for [('447cd8ca-a758-4b0d-966f-d4641376c8a8', None, None, None, None, None)] {{(pid=122399) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 15:54:58.035423 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-f66bd026-cdad-47fe-bf42-243596451ab0 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:58.036391 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-f66bd026-cdad-47fe-bf42-243596451ab0 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:58.046081 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f66bd026-cdad-47fe-bf42-243596451ab0 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:58.050929 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f66bd026-cdad-47fe-bf42-243596451ab0 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:58.052171 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f66bd026-cdad-47fe-bf42-243596451ab0 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:58.052829 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f66bd026-cdad-47fe-bf42-243596451ab0 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:58.333220 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-f66bd026-cdad-47fe-bf42-243596451ab0 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:58.343803 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-f66bd026-cdad-47fe-bf42-243596451ab0 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1576 microversion: 2.1 time: 0.315874 Dec 16 15:54:58.344419 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 417/897] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:58 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1576 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:54:58.617945 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-2f4d6248-c39c-49f0-a7f3-c08cc3f9b638 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Flavor limits 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 15:54:58.618492 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-2f4d6248-c39c-49f0-a7f3-c08cc3f9b638 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Image limits 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 15:54:58.619045 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-2f4d6248-c39c-49f0-a7f3-c08cc3f9b638 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Flavor pref 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 15:54:58.619534 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-2f4d6248-c39c-49f0-a7f3-c08cc3f9b638 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Image pref 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 15:54:58.619973 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-2f4d6248-c39c-49f0-a7f3-c08cc3f9b638 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 15:54:58.629979 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2f4d6248-c39c-49f0-a7f3-c08cc3f9b638 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:58.630430 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2f4d6248-c39c-49f0-a7f3-c08cc3f9b638 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:58.631245 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2f4d6248-c39c-49f0-a7f3-c08cc3f9b638 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:58.631683 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2f4d6248-c39c-49f0-a7f3-c08cc3f9b638 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:58.648530 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-2f4d6248-c39c-49f0-a7f3-c08cc3f9b638 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Getting quotas for project 5afea3407ef84fafa658a82512fb4d24. Resources: {'instances', 'ram', 'cores'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:54:58.652736 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-2f4d6248-c39c-49f0-a7f3-c08cc3f9b638 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Getting quotas for user 92fd364ddd594b9eb5fe5ffad72ac32e and project 5afea3407ef84fafa658a82512fb4d24. Resources: {'instances', 'ram', 'cores'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:54:58.710227 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-2f4d6248-c39c-49f0-a7f3-c08cc3f9b638 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Going to run 1 instances... {{(pid=122399) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 15:54:58.712460 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-2f4d6248-c39c-49f0-a7f3-c08cc3f9b638 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b60467c9-0dcb-419d-ab98-c48a36d7b7d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0cc0d22d-8207-477e-9b77-bb3e8363f503',volume_size=None,volume_type=None)] {{(pid=122399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 15:54:58.768304 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-20435e38-2322-44fa-9b91-0c89e2e05a29 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:58.768871 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-20435e38-2322-44fa-9b91-0c89e2e05a29 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: f8a79670-40b7-4b24-8484-e97517721494] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:58.775500 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-20435e38-2322-44fa-9b91-0c89e2e05a29 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:58.775946 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-20435e38-2322-44fa-9b91-0c89e2e05a29 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:58.776729 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-20435e38-2322-44fa-9b91-0c89e2e05a29 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:58.777158 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-20435e38-2322-44fa-9b91-0c89e2e05a29 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:58.851902 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-2f4d6248-c39c-49f0-a7f3-c08cc3f9b638 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.046739 Dec 16 15:54:58.852644 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 481/898] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Dec 16 15:54:57 2021] POST /compute/v2.1/servers => generated 405 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 16 15:54:58.866607 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.objects.instance [None req-20435e38-2322-44fa-9b91-0c89e2e05a29 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lazy-loading 'services' on Instance uuid f8a79670-40b7-4b24-8484-e97517721494 {{(pid=122398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:54:58.867884 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-7c90c635-8922-4889-b065-41fb5dc82df4 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:58.868666 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-7c90c635-8922-4889-b065-41fb5dc82df4 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b60467c9-0dcb-419d-ab98-c48a36d7b7d5] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:58.945680 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-20435e38-2322-44fa-9b91-0c89e2e05a29 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "DELETE /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494/os-volume_attachments/e74883f6-e9be-4bdb-94ad-9a4df32d14eb" status: 202 len: 0 microversion: 2.1 time: 0.181062 Dec 16 15:54:58.946303 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 418/899] 10.222.0.31 () {58 vars in 1415 bytes} [Thu Dec 16 15:54:58 2021] DELETE /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494/os-volume_attachments/e74883f6-e9be-4bdb-94ad-9a4df32d14eb => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:54:58.971119 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-7c90c635-8922-4889-b065-41fb5dc82df4 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:58.978665 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-7c90c635-8922-4889-b065-41fb5dc82df4 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5" status: 200 len: 1094 microversion: 2.1 time: 0.114876 Dec 16 15:54:58.979695 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 482/900] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:58 2021] GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5 => generated 1094 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:54:59.178573 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-507fdced-ad99-4377-9888-846b82e0fc31 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1023951-dee3-45e5-a902-88af4d8abd5d"}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:54:59.179820 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-507fdced-ad99-4377-9888-846b82e0fc31 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:59.185979 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-507fdced-ad99-4377-9888-846b82e0fc31 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:59.186429 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-507fdced-ad99-4377-9888-846b82e0fc31 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:59.187207 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-507fdced-ad99-4377-9888-846b82e0fc31 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:59.187637 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-507fdced-ad99-4377-9888-846b82e0fc31 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:59.361310 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-86004279-1f32-4995-a3bc-54cc1219dfa9 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:59.361951 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-86004279-1f32-4995-a3bc-54cc1219dfa9 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:54:59.368427 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-86004279-1f32-4995-a3bc-54cc1219dfa9 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:59.368848 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-86004279-1f32-4995-a3bc-54cc1219dfa9 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:59.369667 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-86004279-1f32-4995-a3bc-54cc1219dfa9 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:54:59.370102 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-86004279-1f32-4995-a3bc-54cc1219dfa9 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:54:59.465634 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-507fdced-ad99-4377-9888-846b82e0fc31 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289770 Dec 16 15:54:59.466467 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 419/901] 10.222.0.31 () {60 vars in 1322 bytes} [Thu Dec 16 15:54:59 2021] POST /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:54:59.513830 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-86004279-1f32-4995-a3bc-54cc1219dfa9 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:54:59.521327 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-86004279-1f32-4995-a3bc-54cc1219dfa9 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1576 microversion: 2.1 time: 0.163740 Dec 16 15:54:59.529446 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 483/902] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:59 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:54:59.997149 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-1fcc801d-e5fa-4e6a-8f4b-790248173ff5 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:54:59.997899 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-1fcc801d-e5fa-4e6a-8f4b-790248173ff5 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b60467c9-0dcb-419d-ab98-c48a36d7b7d5] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:00.004154 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1fcc801d-e5fa-4e6a-8f4b-790248173ff5 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:00.004601 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1fcc801d-e5fa-4e6a-8f4b-790248173ff5 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:00.005395 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1fcc801d-e5fa-4e6a-8f4b-790248173ff5 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:00.006254 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1fcc801d-e5fa-4e6a-8f4b-790248173ff5 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:00.082917 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-1fcc801d-e5fa-4e6a-8f4b-790248173ff5 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:00.091334 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-1fcc801d-e5fa-4e6a-8f4b-790248173ff5 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5" status: 200 len: 1210 microversion: 2.1 time: 0.098083 Dec 16 15:55:00.095326 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 420/903] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:54:59 2021] GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5 => generated 1210 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:00.099343 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-e7dc81b6-fcf0-458f-8deb-bc773b0a7d4e tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:00.099825 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-e7dc81b6-fcf0-458f-8deb-bc773b0a7d4e tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: f8a79670-40b7-4b24-8484-e97517721494] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:00.105764 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e7dc81b6-fcf0-458f-8deb-bc773b0a7d4e tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:00.106231 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e7dc81b6-fcf0-458f-8deb-bc773b0a7d4e tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:00.107422 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e7dc81b6-fcf0-458f-8deb-bc773b0a7d4e tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:00.107422 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e7dc81b6-fcf0-458f-8deb-bc773b0a7d4e tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:00.134248 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-e7dc81b6-fcf0-458f-8deb-bc773b0a7d4e tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: f8a79670-40b7-4b24-8484-e97517721494] Going to try to terminate instance {{(pid=122399) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 15:55:00.213278 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-e7dc81b6-fcf0-458f-8deb-bc773b0a7d4e tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "DELETE /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494" status: 204 len: 0 microversion: 2.1 time: 0.118177 Dec 16 15:55:00.214685 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 484/904] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Dec 16 15:55:00 2021] DELETE /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:55:00.222830 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-784cf014-ffa5-4ca6-b841-7eae0f8beb10 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:00.223587 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-784cf014-ffa5-4ca6-b841-7eae0f8beb10 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: f8a79670-40b7-4b24-8484-e97517721494] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:00.231448 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-784cf014-ffa5-4ca6-b841-7eae0f8beb10 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:00.231979 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-784cf014-ffa5-4ca6-b841-7eae0f8beb10 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:00.232906 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-784cf014-ffa5-4ca6-b841-7eae0f8beb10 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:00.233424 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-784cf014-ffa5-4ca6-b841-7eae0f8beb10 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:00.455324 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-784cf014-ffa5-4ca6-b841-7eae0f8beb10 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:00.463112 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-784cf014-ffa5-4ca6-b841-7eae0f8beb10 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494" status: 200 len: 1513 microversion: 2.1 time: 0.244612 Dec 16 15:55:00.463634 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 421/905] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:00 2021] GET /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494 => generated 1513 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:00.539042 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-008dc6dc-db09-4561-badd-09695f42c094 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:00.539711 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-008dc6dc-db09-4561-badd-09695f42c094 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:00.545839 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-008dc6dc-db09-4561-badd-09695f42c094 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:00.546486 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-008dc6dc-db09-4561-badd-09695f42c094 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:00.547440 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-008dc6dc-db09-4561-badd-09695f42c094 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:00.548051 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-008dc6dc-db09-4561-badd-09695f42c094 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:00.751929 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-008dc6dc-db09-4561-badd-09695f42c094 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:00.760851 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-008dc6dc-db09-4561-badd-09695f42c094 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1576 microversion: 2.1 time: 0.225899 Dec 16 15:55:00.761769 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 485/906] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:00 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1576 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:55:01.108498 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-10343ae8-d8b8-4f5a-be37-e517a87844a2 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:01.109137 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-10343ae8-d8b8-4f5a-be37-e517a87844a2 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b60467c9-0dcb-419d-ab98-c48a36d7b7d5] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:01.116340 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-10343ae8-d8b8-4f5a-be37-e517a87844a2 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:01.116785 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-10343ae8-d8b8-4f5a-be37-e517a87844a2 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:01.117619 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-10343ae8-d8b8-4f5a-be37-e517a87844a2 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:01.118054 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-10343ae8-d8b8-4f5a-be37-e517a87844a2 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:01.474283 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-10343ae8-d8b8-4f5a-be37-e517a87844a2 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:01.479958 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-b24efe97-d470-4b1e-9ec6-8f2b00ce4487 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:01.480792 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-b24efe97-d470-4b1e-9ec6-8f2b00ce4487 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: f8a79670-40b7-4b24-8484-e97517721494] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:01.488054 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b24efe97-d470-4b1e-9ec6-8f2b00ce4487 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:01.489239 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b24efe97-d470-4b1e-9ec6-8f2b00ce4487 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:01.490145 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b24efe97-d470-4b1e-9ec6-8f2b00ce4487 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:01.490780 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b24efe97-d470-4b1e-9ec6-8f2b00ce4487 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:01.493699 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-10343ae8-d8b8-4f5a-be37-e517a87844a2 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5" status: 200 len: 1277 microversion: 2.1 time: 0.388789 Dec 16 15:55:01.494334 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 422/907] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:01 2021] GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5 => generated 1277 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:01.715676 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-b24efe97-d470-4b1e-9ec6-8f2b00ce4487 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:01.723268 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-b24efe97-d470-4b1e-9ec6-8f2b00ce4487 tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494" status: 200 len: 1513 microversion: 2.1 time: 0.247004 Dec 16 15:55:01.723830 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 486/908] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:01 2021] GET /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494 => generated 1513 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:55:01.779309 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-78190238-bcc0-4214-84d8-55a1cb25f061 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:01.779915 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-78190238-bcc0-4214-84d8-55a1cb25f061 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:01.786856 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-78190238-bcc0-4214-84d8-55a1cb25f061 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:01.787295 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-78190238-bcc0-4214-84d8-55a1cb25f061 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:01.788075 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-78190238-bcc0-4214-84d8-55a1cb25f061 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:01.788501 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-78190238-bcc0-4214-84d8-55a1cb25f061 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:01.858159 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-adef7d06-74c8-4b7b-a33d-5d18c759edc9 req-96f4f1c0-f583-475d-9c91-797f9fea5728 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b60467c9-0dcb-419d-ab98-c48a36d7b7d5", "tag": "f8559e41-ad86-4e2d-963f-f8c7641fc223"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:55:01.859995 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:55:01.859995 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:55:01.867520 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-adef7d06-74c8-4b7b-a33d-5d18c759edc9 req-96f4f1c0-f583-475d-9c91-797f9fea5728 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:01.868138 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-adef7d06-74c8-4b7b-a33d-5d18c759edc9 req-96f4f1c0-f583-475d-9c91-797f9fea5728 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:01.881831 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-adef7d06-74c8-4b7b-a33d-5d18c759edc9 req-96f4f1c0-f583-475d-9c91-797f9fea5728 service nova] Creating event network-changed:f8559e41-ad86-4e2d-963f-f8c7641fc223 for instance b60467c9-0dcb-419d-ab98-c48a36d7b7d5 on hv-cinder-78447 Dec 16 15:55:01.887995 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-adef7d06-74c8-4b7b-a33d-5d18c759edc9 req-96f4f1c0-f583-475d-9c91-797f9fea5728 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033895 Dec 16 15:55:01.889553 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 487/909] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:55:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:55:01.994481 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-78190238-bcc0-4214-84d8-55a1cb25f061 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:02.002645 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-78190238-bcc0-4214-84d8-55a1cb25f061 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1576 microversion: 2.1 time: 0.227155 Dec 16 15:55:02.003273 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 423/910] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:01 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1576 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:02.512359 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-70ef611d-d72e-499c-ab7e-539de50c3c8d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:02.513783 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-70ef611d-d72e-499c-ab7e-539de50c3c8d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b60467c9-0dcb-419d-ab98-c48a36d7b7d5] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:02.520264 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-70ef611d-d72e-499c-ab7e-539de50c3c8d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:02.520720 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-70ef611d-d72e-499c-ab7e-539de50c3c8d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:02.521525 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-70ef611d-d72e-499c-ab7e-539de50c3c8d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:02.521939 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-70ef611d-d72e-499c-ab7e-539de50c3c8d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:02.740489 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-82819912-ec52-40c1-94df-b09ee82847ff tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:02.742737 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-82819912-ec52-40c1-94df-b09ee82847ff tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: f8a79670-40b7-4b24-8484-e97517721494] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:02.750030 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-82819912-ec52-40c1-94df-b09ee82847ff tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:02.750694 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-82819912-ec52-40c1-94df-b09ee82847ff tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:02.751741 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-82819912-ec52-40c1-94df-b09ee82847ff tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:02.752330 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-82819912-ec52-40c1-94df-b09ee82847ff tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:02.757077 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-70ef611d-d72e-499c-ab7e-539de50c3c8d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:02.765223 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-70ef611d-d72e-499c-ab7e-539de50c3c8d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5" status: 200 len: 1277 microversion: 2.1 time: 0.257459 Dec 16 15:55:02.769718 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 488/911] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:02 2021] GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5 => generated 1277 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:02.829864 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-506c1f25-deed-4343-a999-f87e0dbd811c req-f98f82e7-2cd7-4418-87c5-b25f39f1a704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8a79670-40b7-4b24-8484-e97517721494", "name": "network-vif-deleted", "tag": "6ed2a710-c869-4081-8193-d34b97960b0f"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:55:02.831327 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:55:02.831327 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:55:02.842128 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-506c1f25-deed-4343-a999-f87e0dbd811c req-f98f82e7-2cd7-4418-87c5-b25f39f1a704 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:02.842680 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-506c1f25-deed-4343-a999-f87e0dbd811c req-f98f82e7-2cd7-4418-87c5-b25f39f1a704 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:02.856412 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-506c1f25-deed-4343-a999-f87e0dbd811c req-f98f82e7-2cd7-4418-87c5-b25f39f1a704 service nova] Creating event network-vif-deleted:6ed2a710-c869-4081-8193-d34b97960b0f for instance f8a79670-40b7-4b24-8484-e97517721494 on hv-cinder-78447 Dec 16 15:55:02.859600 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-82819912-ec52-40c1-94df-b09ee82847ff tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a62c94ccf894508af39e5dda01c2dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf339789c6548249d10a3fc90824375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:02.862631 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-506c1f25-deed-4343-a999-f87e0dbd811c req-f98f82e7-2cd7-4418-87c5-b25f39f1a704 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036433 Dec 16 15:55:02.863267 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 489/912] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:55:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:55:02.867944 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-82819912-ec52-40c1-94df-b09ee82847ff tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494" status: 200 len: 1471 microversion: 2.1 time: 0.131598 Dec 16 15:55:02.868977 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 424/913] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:02 2021] GET /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494 => generated 1471 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:03.020132 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-1a5025e2-097c-4904-a4ed-7f5ad115a99c tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:03.020859 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-1a5025e2-097c-4904-a4ed-7f5ad115a99c tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:03.027746 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1a5025e2-097c-4904-a4ed-7f5ad115a99c tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:03.028266 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1a5025e2-097c-4904-a4ed-7f5ad115a99c tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:03.029025 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1a5025e2-097c-4904-a4ed-7f5ad115a99c tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:03.029450 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1a5025e2-097c-4904-a4ed-7f5ad115a99c tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:03.175917 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-1a5025e2-097c-4904-a4ed-7f5ad115a99c tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:03.183423 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-1a5025e2-097c-4904-a4ed-7f5ad115a99c tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1576 microversion: 2.1 time: 0.167556 Dec 16 15:55:03.183994 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 490/914] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:03 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:03.787060 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-264438f7-2fc5-404f-88b0-5d9f5ce9f176 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:03.788030 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-264438f7-2fc5-404f-88b0-5d9f5ce9f176 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b60467c9-0dcb-419d-ab98-c48a36d7b7d5] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:03.796017 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-264438f7-2fc5-404f-88b0-5d9f5ce9f176 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:03.796516 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-264438f7-2fc5-404f-88b0-5d9f5ce9f176 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:03.797289 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-264438f7-2fc5-404f-88b0-5d9f5ce9f176 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:03.797823 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-264438f7-2fc5-404f-88b0-5d9f5ce9f176 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:03.887733 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ac38f1c9-a7c4-4e24-8264-d2c23c50c40d tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:03.888346 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-ac38f1c9-a7c4-4e24-8264-d2c23c50c40d tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] [instance: f8a79670-40b7-4b24-8484-e97517721494] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:03.895107 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ac38f1c9-a7c4-4e24-8264-d2c23c50c40d tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:03.895560 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ac38f1c9-a7c4-4e24-8264-d2c23c50c40d tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:03.896353 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ac38f1c9-a7c4-4e24-8264-d2c23c50c40d tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:03.896776 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ac38f1c9-a7c4-4e24-8264-d2c23c50c40d tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:03.910113 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.wsgi [None req-ac38f1c9-a7c4-4e24-8264-d2c23c50c40d tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] HTTP exception thrown: Instance f8a79670-40b7-4b24-8484-e97517721494 could not be found. Dec 16 15:55:03.910709 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ac38f1c9-a7c4-4e24-8264-d2c23c50c40d tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] Returning 404 to user: Instance f8a79670-40b7-4b24-8484-e97517721494 could not be found. {{(pid=122399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:55:03.911594 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-ac38f1c9-a7c4-4e24-8264-d2c23c50c40d tempest-VolumesSnapshotTestJSON-492498903 tempest-VolumesSnapshotTestJSON-492498903-project] 10.222.0.31 "GET /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494" status: 404 len: 111 microversion: 2.1 time: 0.029676 Dec 16 15:55:03.912109 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 491/915] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:03 2021] GET /compute/v2.1/servers/f8a79670-40b7-4b24-8484-e97517721494 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:55:03.935404 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-264438f7-2fc5-404f-88b0-5d9f5ce9f176 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:03.942781 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-264438f7-2fc5-404f-88b0-5d9f5ce9f176 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5" status: 200 len: 1277 microversion: 2.1 time: 0.160354 Dec 16 15:55:03.943316 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 425/916] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:03 2021] GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5 => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:04.204973 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-11340372-648d-42fb-9df8-6843eef48b84 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:04.205619 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-11340372-648d-42fb-9df8-6843eef48b84 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:04.216086 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-11340372-648d-42fb-9df8-6843eef48b84 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:04.216587 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-11340372-648d-42fb-9df8-6843eef48b84 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:04.217396 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-11340372-648d-42fb-9df8-6843eef48b84 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:04.217858 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-11340372-648d-42fb-9df8-6843eef48b84 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:04.358127 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-11340372-648d-42fb-9df8-6843eef48b84 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:04.365543 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-11340372-648d-42fb-9df8-6843eef48b84 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1576 microversion: 2.1 time: 0.168436 Dec 16 15:55:04.366115 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 492/917] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:04 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:04.963282 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-616218c9-1b0b-4d0d-b0d1-9908388ad20c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:04.964227 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-616218c9-1b0b-4d0d-b0d1-9908388ad20c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b60467c9-0dcb-419d-ab98-c48a36d7b7d5] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:04.972276 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-616218c9-1b0b-4d0d-b0d1-9908388ad20c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:04.972718 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-616218c9-1b0b-4d0d-b0d1-9908388ad20c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:04.973516 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-616218c9-1b0b-4d0d-b0d1-9908388ad20c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:04.973946 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-616218c9-1b0b-4d0d-b0d1-9908388ad20c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:05.112961 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-616218c9-1b0b-4d0d-b0d1-9908388ad20c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:05.120826 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-616218c9-1b0b-4d0d-b0d1-9908388ad20c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5" status: 200 len: 1277 microversion: 2.1 time: 0.163733 Dec 16 15:55:05.121396 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 426/918] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:04 2021] GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5 => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:05.381702 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-22627bdc-6ca5-439d-9150-297a17d46adc tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:05.382317 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-22627bdc-6ca5-439d-9150-297a17d46adc tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:05.389670 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-22627bdc-6ca5-439d-9150-297a17d46adc tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:05.390239 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-22627bdc-6ca5-439d-9150-297a17d46adc tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:05.391161 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-22627bdc-6ca5-439d-9150-297a17d46adc tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:05.391718 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-22627bdc-6ca5-439d-9150-297a17d46adc tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:05.530380 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-22627bdc-6ca5-439d-9150-297a17d46adc tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:05.537989 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-22627bdc-6ca5-439d-9150-297a17d46adc tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1576 microversion: 2.1 time: 0.160010 Dec 16 15:55:05.538550 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 493/919] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:05 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:06.138443 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-0d47af5a-2a0a-4669-b723-a90605685df7 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:06.139052 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-0d47af5a-2a0a-4669-b723-a90605685df7 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b60467c9-0dcb-419d-ab98-c48a36d7b7d5] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:06.145838 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0d47af5a-2a0a-4669-b723-a90605685df7 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:06.146284 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0d47af5a-2a0a-4669-b723-a90605685df7 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:06.147061 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0d47af5a-2a0a-4669-b723-a90605685df7 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:06.147493 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0d47af5a-2a0a-4669-b723-a90605685df7 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:06.278668 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-0d47af5a-2a0a-4669-b723-a90605685df7 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:06.286111 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-0d47af5a-2a0a-4669-b723-a90605685df7 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5" status: 200 len: 1277 microversion: 2.1 time: 0.151438 Dec 16 15:55:06.286686 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 427/920] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:06 2021] GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5 => generated 1277 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:06.557368 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-811df0ea-0cc2-4292-9007-baf733fbf5c3 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:06.558276 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-811df0ea-0cc2-4292-9007-baf733fbf5c3 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:06.565886 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-811df0ea-0cc2-4292-9007-baf733fbf5c3 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:06.566359 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-811df0ea-0cc2-4292-9007-baf733fbf5c3 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:06.567178 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-811df0ea-0cc2-4292-9007-baf733fbf5c3 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:06.567627 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-811df0ea-0cc2-4292-9007-baf733fbf5c3 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:06.703784 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-811df0ea-0cc2-4292-9007-baf733fbf5c3 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:06.711344 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-811df0ea-0cc2-4292-9007-baf733fbf5c3 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1576 microversion: 2.1 time: 0.159245 Dec 16 15:55:06.711909 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 494/921] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:06 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:07.306773 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-3fe97452-9934-472a-b737-a4835374daf0 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:07.307796 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-3fe97452-9934-472a-b737-a4835374daf0 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b60467c9-0dcb-419d-ab98-c48a36d7b7d5] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:07.315571 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3fe97452-9934-472a-b737-a4835374daf0 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:07.316020 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3fe97452-9934-472a-b737-a4835374daf0 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:07.316802 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3fe97452-9934-472a-b737-a4835374daf0 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:07.317231 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3fe97452-9934-472a-b737-a4835374daf0 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:07.460544 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-3fe97452-9934-472a-b737-a4835374daf0 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:07.468213 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-3fe97452-9934-472a-b737-a4835374daf0 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5" status: 200 len: 1277 microversion: 2.1 time: 0.167663 Dec 16 15:55:07.468793 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 428/922] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:07 2021] GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:07.733149 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-7c605911-4dbc-4fc5-b777-90e8126129e7 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:07.733767 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-7c605911-4dbc-4fc5-b777-90e8126129e7 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:07.740825 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7c605911-4dbc-4fc5-b777-90e8126129e7 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:07.741293 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7c605911-4dbc-4fc5-b777-90e8126129e7 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:07.744708 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7c605911-4dbc-4fc5-b777-90e8126129e7 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:07.744708 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7c605911-4dbc-4fc5-b777-90e8126129e7 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:07.877182 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-7c605911-4dbc-4fc5-b777-90e8126129e7 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:07.885085 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-7c605911-4dbc-4fc5-b777-90e8126129e7 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1576 microversion: 2.1 time: 0.157817 Dec 16 15:55:07.885680 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 495/923] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:07 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:08.485805 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-1d29492d-c59f-408a-acfc-a3c93a9c7731 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:08.486490 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-1d29492d-c59f-408a-acfc-a3c93a9c7731 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b60467c9-0dcb-419d-ab98-c48a36d7b7d5] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:08.493399 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1d29492d-c59f-408a-acfc-a3c93a9c7731 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:08.493967 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1d29492d-c59f-408a-acfc-a3c93a9c7731 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:08.494817 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1d29492d-c59f-408a-acfc-a3c93a9c7731 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:08.495319 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1d29492d-c59f-408a-acfc-a3c93a9c7731 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:08.636690 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-1d29492d-c59f-408a-acfc-a3c93a9c7731 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:08.646310 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-1d29492d-c59f-408a-acfc-a3c93a9c7731 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5" status: 200 len: 1277 microversion: 2.1 time: 0.165164 Dec 16 15:55:08.655518 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 429/924] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:08 2021] GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5 => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:08.902032 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ce9b5ecd-572a-4712-8bcf-29905504f3fb tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:08.902625 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-ce9b5ecd-572a-4712-8bcf-29905504f3fb tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:08.909368 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ce9b5ecd-572a-4712-8bcf-29905504f3fb tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:08.909846 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ce9b5ecd-572a-4712-8bcf-29905504f3fb tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:08.910695 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ce9b5ecd-572a-4712-8bcf-29905504f3fb tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:08.911123 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ce9b5ecd-572a-4712-8bcf-29905504f3fb tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:09.051978 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-ce9b5ecd-572a-4712-8bcf-29905504f3fb tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:09.059691 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-ce9b5ecd-572a-4712-8bcf-29905504f3fb tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1576 microversion: 2.1 time: 0.161216 Dec 16 15:55:09.060322 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 496/925] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:08 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:09.663200 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-66265575-889f-4334-9c29-8ebe35919638 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:09.663779 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-66265575-889f-4334-9c29-8ebe35919638 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b60467c9-0dcb-419d-ab98-c48a36d7b7d5] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:09.670461 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-66265575-889f-4334-9c29-8ebe35919638 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:09.670906 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-66265575-889f-4334-9c29-8ebe35919638 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:09.671677 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-66265575-889f-4334-9c29-8ebe35919638 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:09.672111 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-66265575-889f-4334-9c29-8ebe35919638 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:09.809195 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-66265575-889f-4334-9c29-8ebe35919638 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:09.817536 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-66265575-889f-4334-9c29-8ebe35919638 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5" status: 200 len: 1265 microversion: 2.1 time: 0.158072 Dec 16 15:55:09.818148 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 430/926] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:09 2021] GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:10.078658 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-865c58a9-6205-4924-a8df-3d5b146a960d tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:10.079260 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-865c58a9-6205-4924-a8df-3d5b146a960d tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:10.085723 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-865c58a9-6205-4924-a8df-3d5b146a960d tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:10.086190 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-865c58a9-6205-4924-a8df-3d5b146a960d tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:10.086961 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-865c58a9-6205-4924-a8df-3d5b146a960d tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:10.087397 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-865c58a9-6205-4924-a8df-3d5b146a960d tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:10.164312 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-777c1d9b-10d5-4f64-8acf-ba834a18da57 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:10.165433 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-777c1d9b-10d5-4f64-8acf-ba834a18da57 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:10.171680 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-777c1d9b-10d5-4f64-8acf-ba834a18da57 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:10.172091 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-777c1d9b-10d5-4f64-8acf-ba834a18da57 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:10.173084 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-777c1d9b-10d5-4f64-8acf-ba834a18da57 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:10.173318 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-777c1d9b-10d5-4f64-8acf-ba834a18da57 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:10.204688 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-777c1d9b-10d5-4f64-8acf-ba834a18da57 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044168 Dec 16 15:55:10.205263 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 431/927] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Dec 16 15:55:10 2021] GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:55:10.232202 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-865c58a9-6205-4924-a8df-3d5b146a960d tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:10.239989 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-865c58a9-6205-4924-a8df-3d5b146a960d tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1576 microversion: 2.1 time: 0.166408 Dec 16 15:55:10.240576 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 497/928] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:10 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:10.450549 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-f522dd4b-9aae-4c29-8c13-d444e76e2e21 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:10.451217 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-f522dd4b-9aae-4c29-8c13-d444e76e2e21 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:10.461504 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f522dd4b-9aae-4c29-8c13-d444e76e2e21 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:10.462263 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f522dd4b-9aae-4c29-8c13-d444e76e2e21 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:10.463584 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f522dd4b-9aae-4c29-8c13-d444e76e2e21 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:10.464216 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f522dd4b-9aae-4c29-8c13-d444e76e2e21 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:10.494024 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-f522dd4b-9aae-4c29-8c13-d444e76e2e21 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/os-volume_attachments/54fb86fb-1aae-4df8-8fbc-94089285b129" status: 200 len: 194 microversion: 2.1 time: 0.050015 Dec 16 15:55:10.494591 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 432/929] 10.222.0.31 () {58 vars in 1412 bytes} [Thu Dec 16 15:55:10 2021] GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/os-volume_attachments/54fb86fb-1aae-4df8-8fbc-94089285b129 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:55:10.504708 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-d90fbe36-2881-4294-a132-a0bb1d62559f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:10.505301 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-d90fbe36-2881-4294-a132-a0bb1d62559f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:10.511718 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d90fbe36-2881-4294-a132-a0bb1d62559f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:10.512147 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d90fbe36-2881-4294-a132-a0bb1d62559f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:10.512979 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d90fbe36-2881-4294-a132-a0bb1d62559f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:10.513438 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d90fbe36-2881-4294-a132-a0bb1d62559f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:10.599952 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.objects.instance [None req-d90fbe36-2881-4294-a132-a0bb1d62559f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lazy-loading 'services' on Instance uuid 2a13b434-9d4a-4c31-80e7-96e6d17580f1 {{(pid=122399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:55:10.672512 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-d90fbe36-2881-4294-a132-a0bb1d62559f tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "DELETE /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/os-volume_attachments/54fb86fb-1aae-4df8-8fbc-94089285b129" status: 202 len: 0 microversion: 2.1 time: 0.171200 Dec 16 15:55:10.673121 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 498/930] 10.222.0.31 () {58 vars in 1415 bytes} [Thu Dec 16 15:55:10 2021] DELETE /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/os-volume_attachments/54fb86fb-1aae-4df8-8fbc-94089285b129 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:55:10.834719 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-60990341-dc97-4681-8eee-7fb4cb9df1d4 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:10.835377 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-60990341-dc97-4681-8eee-7fb4cb9df1d4 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b60467c9-0dcb-419d-ab98-c48a36d7b7d5] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:10.842121 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-60990341-dc97-4681-8eee-7fb4cb9df1d4 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:10.842565 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-60990341-dc97-4681-8eee-7fb4cb9df1d4 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:10.843334 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-60990341-dc97-4681-8eee-7fb4cb9df1d4 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:10.843765 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-60990341-dc97-4681-8eee-7fb4cb9df1d4 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:10.884759 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-08f24dde-d37f-43bb-a1c6-bc1434a6e9a4 req-9950b9f2-5dea-4b6b-bd4c-56705ebf46dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "248b8eac-f030-4761-a6c9-0ddaf6475f0f", "name": "network-vif-plugged", "status": "completed", "tag": "8e2fdbb4-3edf-41eb-8daa-904ea54bacb1"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:55:10.889044 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:55:10.889044 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:55:10.897816 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-08f24dde-d37f-43bb-a1c6-bc1434a6e9a4 req-9950b9f2-5dea-4b6b-bd4c-56705ebf46dc service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:10.898802 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-08f24dde-d37f-43bb-a1c6-bc1434a6e9a4 req-9950b9f2-5dea-4b6b-bd4c-56705ebf46dc service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:10.912284 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-08f24dde-d37f-43bb-a1c6-bc1434a6e9a4 req-9950b9f2-5dea-4b6b-bd4c-56705ebf46dc service nova] Creating event network-vif-plugged:8e2fdbb4-3edf-41eb-8daa-904ea54bacb1 for instance 248b8eac-f030-4761-a6c9-0ddaf6475f0f on hv-cinder-78447 Dec 16 15:55:10.917263 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-08f24dde-d37f-43bb-a1c6-bc1434a6e9a4 req-9950b9f2-5dea-4b6b-bd4c-56705ebf46dc service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036844 Dec 16 15:55:10.918394 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 499/931] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:55:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:55:10.990501 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-60990341-dc97-4681-8eee-7fb4cb9df1d4 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:10.997816 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-60990341-dc97-4681-8eee-7fb4cb9df1d4 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5" status: 200 len: 1265 microversion: 2.1 time: 0.166765 Dec 16 15:55:10.998396 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 433/932] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:10 2021] GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:11.256988 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-27a3ea65-1667-4712-b343-867cc86eed64 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:11.257929 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-27a3ea65-1667-4712-b343-867cc86eed64 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:11.264248 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-27a3ea65-1667-4712-b343-867cc86eed64 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:11.264758 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-27a3ea65-1667-4712-b343-867cc86eed64 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:11.265648 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-27a3ea65-1667-4712-b343-867cc86eed64 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:11.266085 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-27a3ea65-1667-4712-b343-867cc86eed64 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:11.423118 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-27a3ea65-1667-4712-b343-867cc86eed64 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:11.431307 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-27a3ea65-1667-4712-b343-867cc86eed64 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1576 microversion: 2.1 time: 0.178651 Dec 16 15:55:11.432082 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 500/933] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:11 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:12.014802 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-355801c2-480a-4c40-befb-48db675680ae tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:12.015332 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-355801c2-480a-4c40-befb-48db675680ae tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b60467c9-0dcb-419d-ab98-c48a36d7b7d5] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:12.021827 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-355801c2-480a-4c40-befb-48db675680ae tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:12.022275 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-355801c2-480a-4c40-befb-48db675680ae tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:12.023091 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-355801c2-480a-4c40-befb-48db675680ae tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:12.023528 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-355801c2-480a-4c40-befb-48db675680ae tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:12.160416 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-355801c2-480a-4c40-befb-48db675680ae tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:12.168303 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-355801c2-480a-4c40-befb-48db675680ae tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5" status: 200 len: 1265 microversion: 2.1 time: 0.157424 Dec 16 15:55:12.168860 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 434/934] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:12 2021] GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:12.448733 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-9c87a106-d31a-4559-ba0f-8b2492d582b5 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:12.449371 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-9c87a106-d31a-4559-ba0f-8b2492d582b5 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:12.456901 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9c87a106-d31a-4559-ba0f-8b2492d582b5 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:12.457390 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9c87a106-d31a-4559-ba0f-8b2492d582b5 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:12.458240 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9c87a106-d31a-4559-ba0f-8b2492d582b5 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:12.458902 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9c87a106-d31a-4559-ba0f-8b2492d582b5 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:12.589586 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-9c87a106-d31a-4559-ba0f-8b2492d582b5 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:12.599958 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-9c87a106-d31a-4559-ba0f-8b2492d582b5 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1563 microversion: 2.1 time: 0.155250 Dec 16 15:55:12.600733 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 501/935] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:12 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:12.849006 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-9a1dd89c-f6d6-4021-9f50-1a97ef50a363 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:12.849525 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-9a1dd89c-f6d6-4021-9f50-1a97ef50a363 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:12.855550 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9a1dd89c-f6d6-4021-9f50-1a97ef50a363 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:12.856000 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9a1dd89c-f6d6-4021-9f50-1a97ef50a363 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:12.856775 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9a1dd89c-f6d6-4021-9f50-1a97ef50a363 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:12.857288 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9a1dd89c-f6d6-4021-9f50-1a97ef50a363 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:12.887389 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-9a1dd89c-f6d6-4021-9f50-1a97ef50a363 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/os-volume_attachments/e1023951-dee3-45e5-a902-88af4d8abd5d" status: 200 len: 194 microversion: 2.1 time: 0.042598 Dec 16 15:55:12.887948 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 435/936] 10.222.0.31 () {58 vars in 1412 bytes} [Thu Dec 16 15:55:12 2021] GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/os-volume_attachments/e1023951-dee3-45e5-a902-88af4d8abd5d => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:55:12.900386 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-07e05371-f4fb-4af5-9f60-8f80cb05747d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:12.901144 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-07e05371-f4fb-4af5-9f60-8f80cb05747d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:12.910759 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-07e05371-f4fb-4af5-9f60-8f80cb05747d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:12.911435 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-07e05371-f4fb-4af5-9f60-8f80cb05747d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:12.912578 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-07e05371-f4fb-4af5-9f60-8f80cb05747d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:12.913220 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-07e05371-f4fb-4af5-9f60-8f80cb05747d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:12.995838 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.objects.instance [None req-07e05371-f4fb-4af5-9f60-8f80cb05747d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lazy-loading 'services' on Instance uuid 2a13b434-9d4a-4c31-80e7-96e6d17580f1 {{(pid=122399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:55:13.077275 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-07e05371-f4fb-4af5-9f60-8f80cb05747d tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "DELETE /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/os-volume_attachments/e1023951-dee3-45e5-a902-88af4d8abd5d" status: 202 len: 0 microversion: 2.1 time: 0.182973 Dec 16 15:55:13.077922 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 502/937] 10.222.0.31 () {58 vars in 1415 bytes} [Thu Dec 16 15:55:12 2021] DELETE /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/os-volume_attachments/e1023951-dee3-45e5-a902-88af4d8abd5d => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:55:13.185447 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-83aee7dc-201c-4cf9-96e9-78ad836f332b tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:13.186039 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-83aee7dc-201c-4cf9-96e9-78ad836f332b tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b60467c9-0dcb-419d-ab98-c48a36d7b7d5] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:13.192427 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-83aee7dc-201c-4cf9-96e9-78ad836f332b tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:13.192868 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-83aee7dc-201c-4cf9-96e9-78ad836f332b tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:13.193679 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-83aee7dc-201c-4cf9-96e9-78ad836f332b tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:13.194106 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-83aee7dc-201c-4cf9-96e9-78ad836f332b tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:13.334223 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-83aee7dc-201c-4cf9-96e9-78ad836f332b tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:13.342020 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-83aee7dc-201c-4cf9-96e9-78ad836f332b tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5" status: 200 len: 1265 microversion: 2.1 time: 0.160758 Dec 16 15:55:13.342611 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 436/938] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:13 2021] GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:14.365187 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-0ef4f540-885b-4027-b2af-f947418a3d14 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:14.366268 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-0ef4f540-885b-4027-b2af-f947418a3d14 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b60467c9-0dcb-419d-ab98-c48a36d7b7d5] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:14.376961 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0ef4f540-885b-4027-b2af-f947418a3d14 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:14.377777 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0ef4f540-885b-4027-b2af-f947418a3d14 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:14.379056 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0ef4f540-885b-4027-b2af-f947418a3d14 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:14.379767 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0ef4f540-885b-4027-b2af-f947418a3d14 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:14.529044 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-0ef4f540-885b-4027-b2af-f947418a3d14 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:14.536455 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-0ef4f540-885b-4027-b2af-f947418a3d14 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5" status: 200 len: 1265 microversion: 2.1 time: 0.179227 Dec 16 15:55:14.537012 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 503/939] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:14 2021] GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:15.552411 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-17841a9d-35df-4623-b0cf-cb8b24945e5c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:15.553081 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-17841a9d-35df-4623-b0cf-cb8b24945e5c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b60467c9-0dcb-419d-ab98-c48a36d7b7d5] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:15.559885 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-17841a9d-35df-4623-b0cf-cb8b24945e5c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:15.560339 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-17841a9d-35df-4623-b0cf-cb8b24945e5c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:15.561120 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-17841a9d-35df-4623-b0cf-cb8b24945e5c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:15.561697 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-17841a9d-35df-4623-b0cf-cb8b24945e5c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:15.703851 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-17841a9d-35df-4623-b0cf-cb8b24945e5c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:15.711305 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-17841a9d-35df-4623-b0cf-cb8b24945e5c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5" status: 200 len: 1265 microversion: 2.1 time: 0.162670 Dec 16 15:55:15.711871 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 437/940] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:15 2021] GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:16.731115 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ee69e7fc-1861-4d1b-81db-568e4c9692f8 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:16.731989 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-ee69e7fc-1861-4d1b-81db-568e4c9692f8 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b60467c9-0dcb-419d-ab98-c48a36d7b7d5] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:16.738989 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ee69e7fc-1861-4d1b-81db-568e4c9692f8 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:16.739500 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ee69e7fc-1861-4d1b-81db-568e4c9692f8 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:16.740366 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ee69e7fc-1861-4d1b-81db-568e4c9692f8 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:16.740910 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ee69e7fc-1861-4d1b-81db-568e4c9692f8 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:16.886134 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-ee69e7fc-1861-4d1b-81db-568e4c9692f8 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:16.893590 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-ee69e7fc-1861-4d1b-81db-568e4c9692f8 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5" status: 200 len: 1265 microversion: 2.1 time: 0.166116 Dec 16 15:55:16.894157 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 504/941] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:16 2021] GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:17.399872 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-ba4e75cd-03fc-4c4b-939b-851140b8e2c5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:17.400793 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-ba4e75cd-03fc-4c4b-939b-851140b8e2c5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:17.407375 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ba4e75cd-03fc-4c4b-939b-851140b8e2c5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:17.407817 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ba4e75cd-03fc-4c4b-939b-851140b8e2c5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:17.408580 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ba4e75cd-03fc-4c4b-939b-851140b8e2c5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:17.409001 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ba4e75cd-03fc-4c4b-939b-851140b8e2c5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:17.438731 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-ba4e75cd-03fc-4c4b-939b-851140b8e2c5 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042626 Dec 16 15:55:17.439262 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 438/942] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Dec 16 15:55:17 2021] GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:55:17.545212 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-d9a47bbe-7418-465c-aac4-7bb19df670e6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:17.546178 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-d9a47bbe-7418-465c-aac4-7bb19df670e6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:17.552175 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d9a47bbe-7418-465c-aac4-7bb19df670e6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:17.552622 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d9a47bbe-7418-465c-aac4-7bb19df670e6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:17.553432 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d9a47bbe-7418-465c-aac4-7bb19df670e6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:17.553939 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d9a47bbe-7418-465c-aac4-7bb19df670e6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:17.583198 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-d9a47bbe-7418-465c-aac4-7bb19df670e6 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041748 Dec 16 15:55:17.583679 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 505/943] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Dec 16 15:55:17 2021] GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:55:17.639083 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-6e9f1844-dea4-4cf6-bf57-43842c8b02fb tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:17.639576 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-6e9f1844-dea4-4cf6-bf57-43842c8b02fb tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:17.645889 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6e9f1844-dea4-4cf6-bf57-43842c8b02fb tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:17.646337 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6e9f1844-dea4-4cf6-bf57-43842c8b02fb tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:17.647092 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6e9f1844-dea4-4cf6-bf57-43842c8b02fb tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:17.647533 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6e9f1844-dea4-4cf6-bf57-43842c8b02fb tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:17.672564 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-6e9f1844-dea4-4cf6-bf57-43842c8b02fb tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Going to try to terminate instance {{(pid=122398) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 15:55:17.754525 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-6e9f1844-dea4-4cf6-bf57-43842c8b02fb tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "DELETE /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1" status: 204 len: 0 microversion: 2.1 time: 0.118709 Dec 16 15:55:17.755135 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 439/944] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Dec 16 15:55:17 2021] DELETE /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:55:17.764861 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-07d78d00-67ce-4bf4-b331-c6144e9349b3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:17.765545 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-07d78d00-67ce-4bf4-b331-c6144e9349b3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:17.771573 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-07d78d00-67ce-4bf4-b331-c6144e9349b3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:17.772093 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-07d78d00-67ce-4bf4-b331-c6144e9349b3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:17.772994 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-07d78d00-67ce-4bf4-b331-c6144e9349b3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:17.773543 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-07d78d00-67ce-4bf4-b331-c6144e9349b3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:17.910261 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-07d78d00-67ce-4bf4-b331-c6144e9349b3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:17.911124 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-7018d1ea-f976-4460-b37d-9cd3de9bc64d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:17.911815 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-7018d1ea-f976-4460-b37d-9cd3de9bc64d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b60467c9-0dcb-419d-ab98-c48a36d7b7d5] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:17.918121 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7018d1ea-f976-4460-b37d-9cd3de9bc64d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:17.918307 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-07d78d00-67ce-4bf4-b331-c6144e9349b3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1" status: 200 len: 1675 microversion: 2.1 time: 0.157520 Dec 16 15:55:17.918558 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7018d1ea-f976-4460-b37d-9cd3de9bc64d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:17.923911 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 506/945] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:17 2021] GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:17.924275 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7018d1ea-f976-4460-b37d-9cd3de9bc64d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:17.924275 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7018d1ea-f976-4460-b37d-9cd3de9bc64d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:18.060901 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-7018d1ea-f976-4460-b37d-9cd3de9bc64d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:18.068571 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-7018d1ea-f976-4460-b37d-9cd3de9bc64d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5" status: 200 len: 1265 microversion: 2.1 time: 0.161391 Dec 16 15:55:18.069146 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 440/946] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:17 2021] GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:18.939358 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-6ae5b5be-9675-4a0c-994c-096068a4075c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:18.940403 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-6ae5b5be-9675-4a0c-994c-096068a4075c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:18.951298 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6ae5b5be-9675-4a0c-994c-096068a4075c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:18.952133 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6ae5b5be-9675-4a0c-994c-096068a4075c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:18.953437 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6ae5b5be-9675-4a0c-994c-096068a4075c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:18.954191 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6ae5b5be-9675-4a0c-994c-096068a4075c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:19.086974 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-205722ce-7ffd-4ea5-98d7-7aed5f960ffd tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:19.088733 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-205722ce-7ffd-4ea5-98d7-7aed5f960ffd tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b60467c9-0dcb-419d-ab98-c48a36d7b7d5] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:19.099229 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-6ae5b5be-9675-4a0c-994c-096068a4075c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:19.102777 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-205722ce-7ffd-4ea5-98d7-7aed5f960ffd tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:19.103234 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-205722ce-7ffd-4ea5-98d7-7aed5f960ffd tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:19.104042 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-205722ce-7ffd-4ea5-98d7-7aed5f960ffd tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:19.104471 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-205722ce-7ffd-4ea5-98d7-7aed5f960ffd tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:19.114478 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-6ae5b5be-9675-4a0c-994c-096068a4075c tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1" status: 200 len: 1675 microversion: 2.1 time: 0.181230 Dec 16 15:55:19.124798 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 507/947] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:18 2021] GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1 => generated 1675 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:19.260512 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-205722ce-7ffd-4ea5-98d7-7aed5f960ffd tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:19.268517 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-205722ce-7ffd-4ea5-98d7-7aed5f960ffd tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5" status: 200 len: 1265 microversion: 2.1 time: 0.186264 Dec 16 15:55:19.269268 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 441/948] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:19 2021] GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:20.132062 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-cbdb5094-8d31-4e26-87ea-940da43cfb12 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:20.132699 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-cbdb5094-8d31-4e26-87ea-940da43cfb12 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:20.139545 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-cbdb5094-8d31-4e26-87ea-940da43cfb12 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:20.139995 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-cbdb5094-8d31-4e26-87ea-940da43cfb12 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:20.140781 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-cbdb5094-8d31-4e26-87ea-940da43cfb12 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:20.141263 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-cbdb5094-8d31-4e26-87ea-940da43cfb12 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:20.286240 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-d7d14cae-ebdc-41ff-96d1-2f5852b35d98 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:20.286837 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-d7d14cae-ebdc-41ff-96d1-2f5852b35d98 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b60467c9-0dcb-419d-ab98-c48a36d7b7d5] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:20.297673 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d7d14cae-ebdc-41ff-96d1-2f5852b35d98 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:20.298199 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d7d14cae-ebdc-41ff-96d1-2f5852b35d98 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:20.299061 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d7d14cae-ebdc-41ff-96d1-2f5852b35d98 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:20.299557 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d7d14cae-ebdc-41ff-96d1-2f5852b35d98 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:20.401975 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-cbdb5094-8d31-4e26-87ea-940da43cfb12 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:20.410045 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-cbdb5094-8d31-4e26-87ea-940da43cfb12 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1" status: 200 len: 1675 microversion: 2.1 time: 0.281823 Dec 16 15:55:20.410778 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 508/949] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:20 2021] GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1 => generated 1675 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:20.510778 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-d7d14cae-ebdc-41ff-96d1-2f5852b35d98 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:20.519339 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-d7d14cae-ebdc-41ff-96d1-2f5852b35d98 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5" status: 200 len: 1265 microversion: 2.1 time: 0.237589 Dec 16 15:55:20.519929 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 442/950] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:20 2021] GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:55:20.813011 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-63de9530-aec0-42cb-bf23-3aa74522594d req-3fd0b980-9d52-4d27-a6ce-0d2957c92143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b60467c9-0dcb-419d-ab98-c48a36d7b7d5", "name": "network-vif-plugged", "status": "completed", "tag": "f8559e41-ad86-4e2d-963f-f8c7641fc223"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:55:20.815889 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:55:20.815889 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:55:20.826687 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-63de9530-aec0-42cb-bf23-3aa74522594d req-3fd0b980-9d52-4d27-a6ce-0d2957c92143 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:20.827843 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-63de9530-aec0-42cb-bf23-3aa74522594d req-3fd0b980-9d52-4d27-a6ce-0d2957c92143 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:20.835119 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-8cbc9288-9a7f-4f14-9fc8-5b9bf5a7ccdb req-1c64ccee-3af7-428e-887c-d34857e7c1ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a13b434-9d4a-4c31-80e7-96e6d17580f1", "name": "network-vif-deleted", "tag": "9f9dc2a3-5ad0-4f17-8e45-49ed4219d918"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:55:20.836995 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:55:20.836995 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:55:20.846941 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-8cbc9288-9a7f-4f14-9fc8-5b9bf5a7ccdb req-1c64ccee-3af7-428e-887c-d34857e7c1ab service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:20.847889 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-63de9530-aec0-42cb-bf23-3aa74522594d req-3fd0b980-9d52-4d27-a6ce-0d2957c92143 service nova] Creating event network-vif-plugged:f8559e41-ad86-4e2d-963f-f8c7641fc223 for instance b60467c9-0dcb-419d-ab98-c48a36d7b7d5 on hv-cinder-78447 Dec 16 15:55:20.848254 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-8cbc9288-9a7f-4f14-9fc8-5b9bf5a7ccdb req-1c64ccee-3af7-428e-887c-d34857e7c1ab service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:20.855495 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-63de9530-aec0-42cb-bf23-3aa74522594d req-3fd0b980-9d52-4d27-a6ce-0d2957c92143 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047282 Dec 16 15:55:20.857295 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 509/951] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:55:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:55:20.861632 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-8cbc9288-9a7f-4f14-9fc8-5b9bf5a7ccdb req-1c64ccee-3af7-428e-887c-d34857e7c1ab service nova] Creating event network-vif-deleted:9f9dc2a3-5ad0-4f17-8e45-49ed4219d918 for instance 2a13b434-9d4a-4c31-80e7-96e6d17580f1 on hv-cinder-78447 Dec 16 15:55:20.867620 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-8cbc9288-9a7f-4f14-9fc8-5b9bf5a7ccdb req-1c64ccee-3af7-428e-887c-d34857e7c1ab service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038501 Dec 16 15:55:20.868958 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 443/952] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:55:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:55:21.099720 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-32eef779-da93-470c-8905-31fefa004eff tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:21.100756 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-32eef779-da93-470c-8905-31fefa004eff tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:21.106830 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-32eef779-da93-470c-8905-31fefa004eff tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:21.107262 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-32eef779-da93-470c-8905-31fefa004eff tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:21.108270 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-32eef779-da93-470c-8905-31fefa004eff tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:21.108698 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-32eef779-da93-470c-8905-31fefa004eff tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:21.139056 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-32eef779-da93-470c-8905-31fefa004eff tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/os-volume_attachments/8c488d14-e5f0-40e1-b953-a1caca7de19a" status: 200 len: 194 microversion: 2.20 time: 0.043543 Dec 16 15:55:21.141574 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 510/953] 10.222.0.31 () {60 vars in 1453 bytes} [Thu Dec 16 15:55:21 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/os-volume_attachments/8c488d14-e5f0-40e1-b953-a1caca7de19a => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:55:21.198369 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-f9ef210f-c7dd-4afa-8870-91b5cf329028 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:21.198932 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-f9ef210f-c7dd-4afa-8870-91b5cf329028 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:21.205036 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f9ef210f-c7dd-4afa-8870-91b5cf329028 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:21.205515 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f9ef210f-c7dd-4afa-8870-91b5cf329028 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:21.206288 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f9ef210f-c7dd-4afa-8870-91b5cf329028 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:21.206723 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f9ef210f-c7dd-4afa-8870-91b5cf329028 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:21.284451 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.objects.instance [None req-f9ef210f-c7dd-4afa-8870-91b5cf329028 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lazy-loading 'services' on Instance uuid 635ee3bb-dc82-4d25-95fc-ef55d01f0705 {{(pid=122398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:55:21.359763 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-f9ef210f-c7dd-4afa-8870-91b5cf329028 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "DELETE /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/os-volume_attachments/8c488d14-e5f0-40e1-b953-a1caca7de19a" status: 202 len: 0 microversion: 2.20 time: 0.165354 Dec 16 15:55:21.360695 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 444/954] 10.222.0.31 () {60 vars in 1456 bytes} [Thu Dec 16 15:55:21 2021] DELETE /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/os-volume_attachments/8c488d14-e5f0-40e1-b953-a1caca7de19a => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:55:21.368992 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-dc820a8a-8b20-476d-8d2d-47105526e7b0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:21.370163 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-dc820a8a-8b20-476d-8d2d-47105526e7b0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:21.376543 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-dc820a8a-8b20-476d-8d2d-47105526e7b0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:21.377164 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-dc820a8a-8b20-476d-8d2d-47105526e7b0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:21.377988 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-dc820a8a-8b20-476d-8d2d-47105526e7b0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:21.378430 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-dc820a8a-8b20-476d-8d2d-47105526e7b0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:21.411510 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-dc820a8a-8b20-476d-8d2d-47105526e7b0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046316 Dec 16 15:55:21.411705 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 511/955] 10.222.0.31 () {60 vars in 1342 bytes} [Thu Dec 16 15:55:21 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:55:21.430245 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-f22084e5-fbcd-4a41-8aaf-c4166ede90f3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:21.431080 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-f22084e5-fbcd-4a41-8aaf-c4166ede90f3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:21.443392 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f22084e5-fbcd-4a41-8aaf-c4166ede90f3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:21.444188 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f22084e5-fbcd-4a41-8aaf-c4166ede90f3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:21.444480 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f22084e5-fbcd-4a41-8aaf-c4166ede90f3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:21.444905 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f22084e5-fbcd-4a41-8aaf-c4166ede90f3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:21.488705 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f22084e5-fbcd-4a41-8aaf-c4166ede90f3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:21.490038 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f22084e5-fbcd-4a41-8aaf-c4166ede90f3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:21.490893 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.objects.instance [None req-f22084e5-fbcd-4a41-8aaf-c4166ede90f3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lazy-loading 'fault' on Instance uuid 2a13b434-9d4a-4c31-80e7-96e6d17580f1 {{(pid=122398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:55:21.536496 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-727293a4-9d6d-4ce4-950e-ecec20af9c11 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:21.537243 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-727293a4-9d6d-4ce4-950e-ecec20af9c11 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b60467c9-0dcb-419d-ab98-c48a36d7b7d5] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:21.549277 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-f22084e5-fbcd-4a41-8aaf-c4166ede90f3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922251edc0754769985fdb8be76f5984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82af4eab10342ddbdddd09e11579c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:21.550663 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-727293a4-9d6d-4ce4-950e-ecec20af9c11 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:21.551106 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-727293a4-9d6d-4ce4-950e-ecec20af9c11 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:21.551891 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-727293a4-9d6d-4ce4-950e-ecec20af9c11 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:21.552324 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-727293a4-9d6d-4ce4-950e-ecec20af9c11 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:21.565000 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-f22084e5-fbcd-4a41-8aaf-c4166ede90f3 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1" status: 200 len: 1328 microversion: 2.1 time: 0.140978 Dec 16 15:55:21.566434 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 445/956] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:21 2021] GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1 => generated 1328 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:21.703306 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-727293a4-9d6d-4ce4-950e-ecec20af9c11 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:21.711131 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-727293a4-9d6d-4ce4-950e-ecec20af9c11 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5" status: 200 len: 1265 microversion: 2.1 time: 0.178715 Dec 16 15:55:21.711709 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 512/957] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:21 2021] GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:55:22.423049 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-7fa203db-e25d-4f5b-9c38-5926b3d07b90 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:22.424004 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-7fa203db-e25d-4f5b-9c38-5926b3d07b90 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:22.430239 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7fa203db-e25d-4f5b-9c38-5926b3d07b90 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:22.430680 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7fa203db-e25d-4f5b-9c38-5926b3d07b90 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:22.431441 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7fa203db-e25d-4f5b-9c38-5926b3d07b90 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:22.431863 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7fa203db-e25d-4f5b-9c38-5926b3d07b90 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:22.460898 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-7fa203db-e25d-4f5b-9c38-5926b3d07b90 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041742 Dec 16 15:55:22.461452 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 446/958] 10.222.0.31 () {60 vars in 1342 bytes} [Thu Dec 16 15:55:22 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:22.519221 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-0034c18a-3b7d-407a-8a82-939b8acb9deb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:22.520302 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-0034c18a-3b7d-407a-8a82-939b8acb9deb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:22.526670 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0034c18a-3b7d-407a-8a82-939b8acb9deb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:22.527117 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0034c18a-3b7d-407a-8a82-939b8acb9deb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:22.528020 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0034c18a-3b7d-407a-8a82-939b8acb9deb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:22.528290 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0034c18a-3b7d-407a-8a82-939b8acb9deb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:22.582049 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-3d86a15f-b504-4129-b42f-22c3e734c46b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:22.582970 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-3d86a15f-b504-4129-b42f-22c3e734c46b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:22.590529 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3d86a15f-b504-4129-b42f-22c3e734c46b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:22.590997 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3d86a15f-b504-4129-b42f-22c3e734c46b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:22.591832 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3d86a15f-b504-4129-b42f-22c3e734c46b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:22.592252 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3d86a15f-b504-4129-b42f-22c3e734c46b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:22.615858 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.wsgi [None req-3d86a15f-b504-4129-b42f-22c3e734c46b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] HTTP exception thrown: Instance 2a13b434-9d4a-4c31-80e7-96e6d17580f1 could not be found. Dec 16 15:55:22.616470 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-3d86a15f-b504-4129-b42f-22c3e734c46b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Returning 404 to user: Instance 2a13b434-9d4a-4c31-80e7-96e6d17580f1 could not be found. {{(pid=122398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:55:22.617303 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-3d86a15f-b504-4129-b42f-22c3e734c46b tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1" status: 404 len: 111 microversion: 2.1 time: 0.039353 Dec 16 15:55:22.617993 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 447/959] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:22 2021] GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:55:22.626938 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-e20d0bca-4375-449a-a022-2d45abf75c43 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '.version_select at 0x7fed5df0c550>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:22.647583 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-e20d0bca-4375-449a-a022-2d45abf75c43 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1053941765" status: 202 len: 0 microversion: 2.1 time: 0.024355 Dec 16 15:55:22.648174 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 448/960] 10.222.0.31 () {58 vars in 1220 bytes} [Thu Dec 16 15:55:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1053941765 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:55:22.723273 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-0034c18a-3b7d-407a-8a82-939b8acb9deb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Going to try to terminate instance {{(pid=122399) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 15:55:22.728551 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-7beb21df-a74a-4db2-a57b-d77b14a8b79c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:22.729286 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-7beb21df-a74a-4db2-a57b-d77b14a8b79c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b60467c9-0dcb-419d-ab98-c48a36d7b7d5] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:22.735519 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7beb21df-a74a-4db2-a57b-d77b14a8b79c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:22.736072 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7beb21df-a74a-4db2-a57b-d77b14a8b79c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:22.737115 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7beb21df-a74a-4db2-a57b-d77b14a8b79c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:22.737590 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7beb21df-a74a-4db2-a57b-d77b14a8b79c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:22.819073 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-0034c18a-3b7d-407a-8a82-939b8acb9deb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "DELETE /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 204 len: 0 microversion: 2.20 time: 0.303276 Dec 16 15:55:22.819782 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 513/961] 10.222.0.31 () {60 vars in 1279 bytes} [Thu Dec 16 15:55:22 2021] DELETE /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 16 15:55:22.829769 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-f22a7082-cce8-4f0d-8094-f97fe4485ed4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:22.830466 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-f22a7082-cce8-4f0d-8094-f97fe4485ed4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:22.841561 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f22a7082-cce8-4f0d-8094-f97fe4485ed4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:22.842091 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f22a7082-cce8-4f0d-8094-f97fe4485ed4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:22.842911 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f22a7082-cce8-4f0d-8094-f97fe4485ed4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:22.843656 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f22a7082-cce8-4f0d-8094-f97fe4485ed4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:22.999505 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-7beb21df-a74a-4db2-a57b-d77b14a8b79c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:23.007397 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-7beb21df-a74a-4db2-a57b-d77b14a8b79c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5" status: 200 len: 1450 microversion: 2.1 time: 0.282747 Dec 16 15:55:23.007980 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 449/962] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:22 2021] GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5 => generated 1450 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:23.023769 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-afaf1f1a-24c7-435d-ae12-babb0f0edbdf tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:23.024376 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-afaf1f1a-24c7-435d-ae12-babb0f0edbdf tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b60467c9-0dcb-419d-ab98-c48a36d7b7d5] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:23.030742 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-afaf1f1a-24c7-435d-ae12-babb0f0edbdf tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:23.031182 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-afaf1f1a-24c7-435d-ae12-babb0f0edbdf tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:23.032078 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-afaf1f1a-24c7-435d-ae12-babb0f0edbdf tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:23.032506 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-afaf1f1a-24c7-435d-ae12-babb0f0edbdf tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:23.394981 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-f22a7082-cce8-4f0d-8094-f97fe4485ed4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:23.403680 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-f22a7082-cce8-4f0d-8094-f97fe4485ed4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:23.405213 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-f22a7082-cce8-4f0d-8094-f97fe4485ed4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:23.406408 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-f22a7082-cce8-4f0d-8094-f97fe4485ed4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1725 microversion: 2.20 time: 0.580903 Dec 16 15:55:23.406946 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 514/963] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:55:22 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1725 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:55:23.491829 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-afaf1f1a-24c7-435d-ae12-babb0f0edbdf tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:23.499835 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-afaf1f1a-24c7-435d-ae12-babb0f0edbdf tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5" status: 200 len: 1450 microversion: 2.1 time: 0.479889 Dec 16 15:55:23.507817 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 450/964] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:23 2021] GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5 => generated 1450 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:24.426000 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-e99cab28-703f-4405-bff6-f68c16b2aae0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:24.426586 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-e99cab28-703f-4405-bff6-f68c16b2aae0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:24.432986 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e99cab28-703f-4405-bff6-f68c16b2aae0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:24.433471 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e99cab28-703f-4405-bff6-f68c16b2aae0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:24.434295 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e99cab28-703f-4405-bff6-f68c16b2aae0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:24.434701 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e99cab28-703f-4405-bff6-f68c16b2aae0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:24.573896 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-e99cab28-703f-4405-bff6-f68c16b2aae0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:24.582178 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-e99cab28-703f-4405-bff6-f68c16b2aae0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:24.583678 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-e99cab28-703f-4405-bff6-f68c16b2aae0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:24.584847 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-e99cab28-703f-4405-bff6-f68c16b2aae0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1725 microversion: 2.20 time: 0.162754 Dec 16 15:55:24.585438 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 515/965] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:55:24 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:55:25.158365 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-ea9b2846-5616-4cdf-b90c-882248af7f88 req-784b35d1-1437-4cab-a599-da957d88b8a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b60467c9-0dcb-419d-ab98-c48a36d7b7d5", "tag": "f8559e41-ad86-4e2d-963f-f8c7641fc223"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:55:25.160564 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:55:25.160564 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:55:25.168281 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-ea9b2846-5616-4cdf-b90c-882248af7f88 req-784b35d1-1437-4cab-a599-da957d88b8a8 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:25.168932 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-ea9b2846-5616-4cdf-b90c-882248af7f88 req-784b35d1-1437-4cab-a599-da957d88b8a8 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:25.182747 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-ea9b2846-5616-4cdf-b90c-882248af7f88 req-784b35d1-1437-4cab-a599-da957d88b8a8 service nova] Creating event network-changed:f8559e41-ad86-4e2d-963f-f8c7641fc223 for instance b60467c9-0dcb-419d-ab98-c48a36d7b7d5 on hv-cinder-78447 Dec 16 15:55:25.189099 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-ea9b2846-5616-4cdf-b90c-882248af7f88 req-784b35d1-1437-4cab-a599-da957d88b8a8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034161 Dec 16 15:55:25.190315 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 451/966] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:55:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:55:25.529235 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-2fdcdbc4-71b7-4be7-9d4f-a6465e1a12f0 req-6c9db530-593c-435e-a894-4db565ee4372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635ee3bb-dc82-4d25-95fc-ef55d01f0705", "name": "network-vif-deleted", "tag": "d48abd91-ed3c-4f04-8767-5e6f0211d6fe"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:55:25.531491 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:55:25.531491 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:55:25.544806 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-2fdcdbc4-71b7-4be7-9d4f-a6465e1a12f0 req-6c9db530-593c-435e-a894-4db565ee4372 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:25.545814 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-2fdcdbc4-71b7-4be7-9d4f-a6465e1a12f0 req-6c9db530-593c-435e-a894-4db565ee4372 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:25.561919 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-2fdcdbc4-71b7-4be7-9d4f-a6465e1a12f0 req-6c9db530-593c-435e-a894-4db565ee4372 service nova] Creating event network-vif-deleted:d48abd91-ed3c-4f04-8767-5e6f0211d6fe for instance 635ee3bb-dc82-4d25-95fc-ef55d01f0705 on hv-cinder-78447 Dec 16 15:55:25.568131 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-2fdcdbc4-71b7-4be7-9d4f-a6465e1a12f0 req-6c9db530-593c-435e-a894-4db565ee4372 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042087 Dec 16 15:55:25.574026 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 516/967] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:55:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:55:25.604871 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-af957cfe-284a-4387-8094-bc8893e5f4ca tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:25.605898 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-af957cfe-284a-4387-8094-bc8893e5f4ca tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:25.620852 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-af957cfe-284a-4387-8094-bc8893e5f4ca tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:25.621327 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-af957cfe-284a-4387-8094-bc8893e5f4ca tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:25.622301 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-af957cfe-284a-4387-8094-bc8893e5f4ca tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:25.622737 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-af957cfe-284a-4387-8094-bc8893e5f4ca tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:25.705008 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-af957cfe-284a-4387-8094-bc8893e5f4ca tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:25.716534 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-af957cfe-284a-4387-8094-bc8893e5f4ca tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:25.718153 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-af957cfe-284a-4387-8094-bc8893e5f4ca tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:25.719796 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-af957cfe-284a-4387-8094-bc8893e5f4ca tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 200 len: 1366 microversion: 2.20 time: 0.119492 Dec 16 15:55:25.720864 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 452/968] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:55:25 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 1366 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:55:26.087047 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-4b57edf1-7735-4481-a86e-15d536bbb748 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:26.087989 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-4b57edf1-7735-4481-a86e-15d536bbb748 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:26.095112 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4b57edf1-7735-4481-a86e-15d536bbb748 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:26.096662 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4b57edf1-7735-4481-a86e-15d536bbb748 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:26.097759 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4b57edf1-7735-4481-a86e-15d536bbb748 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:26.098361 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4b57edf1-7735-4481-a86e-15d536bbb748 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:26.113790 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.wsgi [None req-4b57edf1-7735-4481-a86e-15d536bbb748 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] HTTP exception thrown: Instance 2a13b434-9d4a-4c31-80e7-96e6d17580f1 could not be found. Dec 16 15:55:26.114701 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-4b57edf1-7735-4481-a86e-15d536bbb748 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Returning 404 to user: Instance 2a13b434-9d4a-4c31-80e7-96e6d17580f1 could not be found. {{(pid=122399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:55:26.115761 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-4b57edf1-7735-4481-a86e-15d536bbb748 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "DELETE /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1" status: 404 len: 111 microversion: 2.1 time: 0.033855 Dec 16 15:55:26.120581 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 517/969] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Dec 16 15:55:26 2021] DELETE /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:55:26.126563 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-da624284-4e5b-4772-85b3-d97486a71023 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:26.127092 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-da624284-4e5b-4772-85b3-d97486a71023 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 2a13b434-9d4a-4c31-80e7-96e6d17580f1] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:26.136948 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-da624284-4e5b-4772-85b3-d97486a71023 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:26.137630 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-da624284-4e5b-4772-85b3-d97486a71023 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:26.141571 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-da624284-4e5b-4772-85b3-d97486a71023 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:26.142549 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-da624284-4e5b-4772-85b3-d97486a71023 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:26.169647 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.wsgi [None req-da624284-4e5b-4772-85b3-d97486a71023 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] HTTP exception thrown: Instance 2a13b434-9d4a-4c31-80e7-96e6d17580f1 could not be found. Dec 16 15:55:26.170982 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-da624284-4e5b-4772-85b3-d97486a71023 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Returning 404 to user: Instance 2a13b434-9d4a-4c31-80e7-96e6d17580f1 could not be found. {{(pid=122398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:55:26.172006 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-da624284-4e5b-4772-85b3-d97486a71023 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1" status: 404 len: 111 microversion: 2.1 time: 0.050686 Dec 16 15:55:26.173688 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 453/970] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:26 2021] GET /compute/v2.1/servers/2a13b434-9d4a-4c31-80e7-96e6d17580f1 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 16 15:55:26.737867 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-9be9e714-f494-4e42-ab65-e1fddd8dc910 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:26.742226 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-9be9e714-f494-4e42-ab65-e1fddd8dc910 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:26.749173 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9be9e714-f494-4e42-ab65-e1fddd8dc910 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:26.749365 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9be9e714-f494-4e42-ab65-e1fddd8dc910 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:26.750206 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9be9e714-f494-4e42-ab65-e1fddd8dc910 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:26.750736 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9be9e714-f494-4e42-ab65-e1fddd8dc910 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:26.770004 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.wsgi [None req-9be9e714-f494-4e42-ab65-e1fddd8dc910 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] HTTP exception thrown: Instance 635ee3bb-dc82-4d25-95fc-ef55d01f0705 could not be found. Dec 16 15:55:26.771235 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-9be9e714-f494-4e42-ab65-e1fddd8dc910 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Returning 404 to user: Instance 635ee3bb-dc82-4d25-95fc-ef55d01f0705 could not be found. {{(pid=122399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:55:26.772144 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-9be9e714-f494-4e42-ab65-e1fddd8dc910 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 404 len: 111 microversion: 2.20 time: 0.038012 Dec 16 15:55:26.776036 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 518/971] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:55:26 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 16 15:55:26.781314 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-5d26341b-d74a-4b93-b52f-0fea64277540 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '.version_select at 0x7fed5dff00d0>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:26.801782 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-5d26341b-d74a-4b93-b52f-0fea64277540 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1889749874" status: 204 len: 0 microversion: 2.20 time: 0.024380 Dec 16 15:55:26.802661 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 454/972] 10.222.0.31 () {60 vars in 1261 bytes} [Thu Dec 16 15:55:26 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1889749874 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 16 15:55:27.351270 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-3584f710-4980-46b7-9842-2fcca6d52706 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:27.351962 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-3584f710-4980-46b7-9842-2fcca6d52706 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:27.359086 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3584f710-4980-46b7-9842-2fcca6d52706 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:27.359757 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3584f710-4980-46b7-9842-2fcca6d52706 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:27.360713 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3584f710-4980-46b7-9842-2fcca6d52706 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:27.361259 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3584f710-4980-46b7-9842-2fcca6d52706 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:27.376996 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.wsgi [None req-3584f710-4980-46b7-9842-2fcca6d52706 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] HTTP exception thrown: Instance 29bba044-2e01-44b1-bb03-0f367846a5f0 could not be found. Dec 16 15:55:27.377702 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-3584f710-4980-46b7-9842-2fcca6d52706 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Returning 404 to user: Instance 29bba044-2e01-44b1-bb03-0f367846a5f0 could not be found. {{(pid=122399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:55:27.378669 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-3584f710-4980-46b7-9842-2fcca6d52706 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "DELETE /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 404 len: 111 microversion: 2.1 time: 0.031278 Dec 16 15:55:27.379358 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 519/973] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Dec 16 15:55:27 2021] DELETE /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:55:27.389701 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-46e560c1-8edc-4709-bfc5-672862c2b353 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:27.390361 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-46e560c1-8edc-4709-bfc5-672862c2b353 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] [instance: 29bba044-2e01-44b1-bb03-0f367846a5f0] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:27.399423 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-46e560c1-8edc-4709-bfc5-672862c2b353 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:27.400144 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-46e560c1-8edc-4709-bfc5-672862c2b353 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:27.401123 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-46e560c1-8edc-4709-bfc5-672862c2b353 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:27.401743 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-46e560c1-8edc-4709-bfc5-672862c2b353 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:27.416605 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.wsgi [None req-46e560c1-8edc-4709-bfc5-672862c2b353 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] HTTP exception thrown: Instance 29bba044-2e01-44b1-bb03-0f367846a5f0 could not be found. Dec 16 15:55:27.417643 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-46e560c1-8edc-4709-bfc5-672862c2b353 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] Returning 404 to user: Instance 29bba044-2e01-44b1-bb03-0f367846a5f0 could not be found. {{(pid=122398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:55:27.418489 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-46e560c1-8edc-4709-bfc5-672862c2b353 tempest-AttachVolumeTestJSON-880704654 tempest-AttachVolumeTestJSON-880704654-project] 10.222.0.31 "GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0" status: 404 len: 111 microversion: 2.1 time: 0.034351 Dec 16 15:55:27.430070 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 455/974] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:55:27 2021] GET /compute/v2.1/servers/29bba044-2e01-44b1-bb03-0f367846a5f0 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:55:27.528840 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-1fc42c9d-7dfe-4473-abeb-c69a48a3691e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'create', calling method: .version_select at 0x7fed5de918b0>, body: {"keypair": {"name": "tempest-keypair-1931689108"}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:55:27.544036 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-1fc42c9d-7dfe-4473-abeb-c69a48a3691e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Getting quotas for project 66fbf45043974460803db71f1750aacc. Resources: {'key_pairs'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:55:27.547841 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-1fc42c9d-7dfe-4473-abeb-c69a48a3691e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Getting quotas for user 5cef547b44664cf48870933998504758 and project 66fbf45043974460803db71f1750aacc. Resources: {'key_pairs'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:55:27.738007 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-1fc42c9d-7dfe-4473-abeb-c69a48a3691e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Getting quotas for project 66fbf45043974460803db71f1750aacc. Resources: {'key_pairs'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:55:27.741864 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-1fc42c9d-7dfe-4473-abeb-c69a48a3691e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Getting quotas for user 5cef547b44664cf48870933998504758 and project 66fbf45043974460803db71f1750aacc. Resources: {'key_pairs'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:55:27.755826 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-1fc42c9d-7dfe-4473-abeb-c69a48a3691e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.230840 Dec 16 15:55:27.756596 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 520/975] 10.222.0.31 () {62 vars in 1198 bytes} [Thu Dec 16 15:55:27 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 232 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 16 15:55:29.130139 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-fd0fa6d6-370d-4e82-81be-a6052c22a674 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1416218939", "imageRef": "2a1434ad-0c2c-4725-baad-a605624baf01", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d7f36349-73c7-464a-bf62-5f09a6e738d6"}], "security_groups": [{"name": "tempest-securitygroup--1430733061"}], "key_name": "tempest-keypair-1931689108", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:55:29.233388 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.network.neutron [None req-fd0fa6d6-370d-4e82-81be-a6052c22a674 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] validate_networks() for [('d7f36349-73c7-464a-bf62-5f09a6e738d6', None, None, None, None, None)] {{(pid=122398) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 15:55:29.618750 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-fd0fa6d6-370d-4e82-81be-a6052c22a674 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Flavor limits 0:0:0 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 15:55:29.619806 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-fd0fa6d6-370d-4e82-81be-a6052c22a674 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Image limits 0:0:0 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 15:55:29.620901 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-fd0fa6d6-370d-4e82-81be-a6052c22a674 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Flavor pref 0:0:0 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 15:55:29.621480 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-fd0fa6d6-370d-4e82-81be-a6052c22a674 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Image pref 0:0:0 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 15:55:29.621998 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.virt.hardware [None req-fd0fa6d6-370d-4e82-81be-a6052c22a674 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 15:55:29.631416 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-fd0fa6d6-370d-4e82-81be-a6052c22a674 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:29.632179 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-fd0fa6d6-370d-4e82-81be-a6052c22a674 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:29.633187 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-fd0fa6d6-370d-4e82-81be-a6052c22a674 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:29.633867 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-fd0fa6d6-370d-4e82-81be-a6052c22a674 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:29.650799 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.quota [None req-fd0fa6d6-370d-4e82-81be-a6052c22a674 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Getting quotas for project 66fbf45043974460803db71f1750aacc. Resources: {'instances', 'ram', 'cores'} {{(pid=122398) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:55:29.654827 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.quota [None req-fd0fa6d6-370d-4e82-81be-a6052c22a674 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Getting quotas for user 5cef547b44664cf48870933998504758 and project 66fbf45043974460803db71f1750aacc. Resources: {'instances', 'ram', 'cores'} {{(pid=122398) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:55:29.665656 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-fd0fa6d6-370d-4e82-81be-a6052c22a674 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Going to run 1 instances... {{(pid=122398) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 15:55:29.668082 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-fd0fa6d6-370d-4e82-81be-a6052c22a674 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a1434ad-0c2c-4725-baad-a605624baf01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122398) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 15:55:29.719836 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-fd0fa6d6-370d-4e82-81be-a6052c22a674 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.593418 Dec 16 15:55:29.720488 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 456/976] 10.222.0.31 () {62 vars in 1187 bytes} [Thu Dec 16 15:55:29 2021] POST /compute/v2.1/servers => generated 402 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 16 15:55:29.732427 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-86d67de3-3cf2-4ce7-bbb6-acb6f3d6c3fe tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:29.733154 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-86d67de3-3cf2-4ce7-bbb6-acb6f3d6c3fe tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:29.791308 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-86d67de3-3cf2-4ce7-bbb6-acb6f3d6c3fe tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:29.801477 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-86d67de3-3cf2-4ce7-bbb6-acb6f3d6c3fe tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:29.804052 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-86d67de3-3cf2-4ce7-bbb6-acb6f3d6c3fe tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:29.805451 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-86d67de3-3cf2-4ce7-bbb6-acb6f3d6c3fe tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1282 microversion: 2.20 time: 0.078684 Dec 16 15:55:29.807756 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 521/977] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:55:29 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1282 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:55:30.826045 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-3364a8d7-c6ad-4dda-b810-fdc89923ff5f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:30.827426 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-3364a8d7-c6ad-4dda-b810-fdc89923ff5f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:30.834345 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3364a8d7-c6ad-4dda-b810-fdc89923ff5f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:30.834793 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3364a8d7-c6ad-4dda-b810-fdc89923ff5f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:30.835767 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3364a8d7-c6ad-4dda-b810-fdc89923ff5f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:30.836401 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-3364a8d7-c6ad-4dda-b810-fdc89923ff5f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:30.948206 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-3364a8d7-c6ad-4dda-b810-fdc89923ff5f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:30.959698 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-3364a8d7-c6ad-4dda-b810-fdc89923ff5f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:30.962935 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-3364a8d7-c6ad-4dda-b810-fdc89923ff5f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:30.965133 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-3364a8d7-c6ad-4dda-b810-fdc89923ff5f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1352 microversion: 2.20 time: 0.143672 Dec 16 15:55:30.971070 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 457/978] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:55:30 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1352 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:55:31.988114 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-361b0f7a-3020-49a8-8784-700b144151c9 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:31.988732 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-361b0f7a-3020-49a8-8784-700b144151c9 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:31.995698 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-361b0f7a-3020-49a8-8784-700b144151c9 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:31.996761 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-361b0f7a-3020-49a8-8784-700b144151c9 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:31.999474 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-361b0f7a-3020-49a8-8784-700b144151c9 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:32.000308 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-361b0f7a-3020-49a8-8784-700b144151c9 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:32.158543 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-361b0f7a-3020-49a8-8784-700b144151c9 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:32.170675 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-361b0f7a-3020-49a8-8784-700b144151c9 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:32.172205 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-361b0f7a-3020-49a8-8784-700b144151c9 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:32.173319 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-361b0f7a-3020-49a8-8784-700b144151c9 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1408 microversion: 2.20 time: 0.189062 Dec 16 15:55:32.182395 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 522/979] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:55:31 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1408 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:55:32.637385 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-ef846c70-2e51-446a-b464-b9b296e22a6f req-12069660-0132-4ebf-8d98-b6489240c53e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53cb08f0-26a5-4811-9df7-b5a346757838", "tag": "18769a46-6816-4b5e-bcc0-d0d8cac455d6"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:55:32.641352 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:55:32.641352 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:55:32.675115 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-ef846c70-2e51-446a-b464-b9b296e22a6f req-12069660-0132-4ebf-8d98-b6489240c53e service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:32.676581 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-ef846c70-2e51-446a-b464-b9b296e22a6f req-12069660-0132-4ebf-8d98-b6489240c53e service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:32.690571 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-ef846c70-2e51-446a-b464-b9b296e22a6f req-12069660-0132-4ebf-8d98-b6489240c53e service nova] Creating event network-changed:18769a46-6816-4b5e-bcc0-d0d8cac455d6 for instance 53cb08f0-26a5-4811-9df7-b5a346757838 on hv-cinder-78447 Dec 16 15:55:32.697259 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-ef846c70-2e51-446a-b464-b9b296e22a6f req-12069660-0132-4ebf-8d98-b6489240c53e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067125 Dec 16 15:55:32.698557 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 458/980] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:55:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:55:33.193775 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-adac8d57-1c5b-4930-8ea4-49939c6a56b5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:33.194379 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-adac8d57-1c5b-4930-8ea4-49939c6a56b5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:33.200675 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-adac8d57-1c5b-4930-8ea4-49939c6a56b5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:33.201119 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-adac8d57-1c5b-4930-8ea4-49939c6a56b5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:33.202165 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-adac8d57-1c5b-4930-8ea4-49939c6a56b5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:33.202603 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-adac8d57-1c5b-4930-8ea4-49939c6a56b5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:33.347274 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-adac8d57-1c5b-4930-8ea4-49939c6a56b5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:33.362477 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-adac8d57-1c5b-4930-8ea4-49939c6a56b5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:33.364756 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-adac8d57-1c5b-4930-8ea4-49939c6a56b5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:33.365932 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-adac8d57-1c5b-4930-8ea4-49939c6a56b5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1408 microversion: 2.20 time: 0.176007 Dec 16 15:55:33.366489 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 523/981] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:55:33 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:55:34.384715 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-606b6d75-7a6c-400d-886f-1b28817b6e32 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:34.385470 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-606b6d75-7a6c-400d-886f-1b28817b6e32 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:34.393720 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-606b6d75-7a6c-400d-886f-1b28817b6e32 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:34.393720 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-606b6d75-7a6c-400d-886f-1b28817b6e32 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:34.393720 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-606b6d75-7a6c-400d-886f-1b28817b6e32 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:34.393720 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-606b6d75-7a6c-400d-886f-1b28817b6e32 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:34.579935 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-606b6d75-7a6c-400d-886f-1b28817b6e32 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:34.588530 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-606b6d75-7a6c-400d-886f-1b28817b6e32 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:34.590078 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-606b6d75-7a6c-400d-886f-1b28817b6e32 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:34.591166 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-606b6d75-7a6c-400d-886f-1b28817b6e32 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1408 microversion: 2.20 time: 0.211167 Dec 16 15:55:34.591752 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 459/982] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:55:34 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1408 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:55:35.609609 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-30795ca3-639d-4f28-8354-4a81c715964a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:35.610192 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-30795ca3-639d-4f28-8354-4a81c715964a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:35.616696 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-30795ca3-639d-4f28-8354-4a81c715964a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:35.617145 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-30795ca3-639d-4f28-8354-4a81c715964a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:35.617958 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-30795ca3-639d-4f28-8354-4a81c715964a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:35.618399 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-30795ca3-639d-4f28-8354-4a81c715964a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:35.754877 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-30795ca3-639d-4f28-8354-4a81c715964a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:35.765282 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-30795ca3-639d-4f28-8354-4a81c715964a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:35.766831 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-30795ca3-639d-4f28-8354-4a81c715964a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:35.767949 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-30795ca3-639d-4f28-8354-4a81c715964a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1408 microversion: 2.20 time: 0.162189 Dec 16 15:55:35.768495 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 524/983] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:55:35 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:55:36.785964 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-e78f2111-008f-4d42-8fce-8f13a54bba19 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:36.786628 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-e78f2111-008f-4d42-8fce-8f13a54bba19 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:36.793113 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e78f2111-008f-4d42-8fce-8f13a54bba19 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:36.793718 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e78f2111-008f-4d42-8fce-8f13a54bba19 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:36.794575 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e78f2111-008f-4d42-8fce-8f13a54bba19 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:36.795211 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e78f2111-008f-4d42-8fce-8f13a54bba19 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:36.848523 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-47d83869-1ffc-4413-b52a-adb7dff26415 req-b7141491-6cfb-44b8-bd0b-4d329226f2de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53cb08f0-26a5-4811-9df7-b5a346757838", "name": "network-vif-plugged", "status": "completed", "tag": "18769a46-6816-4b5e-bcc0-d0d8cac455d6"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:55:36.850429 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:55:36.850429 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:55:36.858346 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-47d83869-1ffc-4413-b52a-adb7dff26415 req-b7141491-6cfb-44b8-bd0b-4d329226f2de service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:36.859168 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-47d83869-1ffc-4413-b52a-adb7dff26415 req-b7141491-6cfb-44b8-bd0b-4d329226f2de service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:36.876277 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-47d83869-1ffc-4413-b52a-adb7dff26415 req-b7141491-6cfb-44b8-bd0b-4d329226f2de service nova] Creating event network-vif-plugged:18769a46-6816-4b5e-bcc0-d0d8cac455d6 for instance 53cb08f0-26a5-4811-9df7-b5a346757838 on hv-cinder-78447 Dec 16 15:55:36.882140 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-47d83869-1ffc-4413-b52a-adb7dff26415 req-b7141491-6cfb-44b8-bd0b-4d329226f2de service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037218 Dec 16 15:55:36.883154 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 525/984] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:55:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:55:36.958697 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-e78f2111-008f-4d42-8fce-8f13a54bba19 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:36.970973 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-e78f2111-008f-4d42-8fce-8f13a54bba19 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:36.973073 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-e78f2111-008f-4d42-8fce-8f13a54bba19 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:36.975261 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-e78f2111-008f-4d42-8fce-8f13a54bba19 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1408 microversion: 2.20 time: 0.192847 Dec 16 15:55:36.977527 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 460/985] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:55:36 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1408 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:55:37.995294 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-3f99525b-2754-4313-a4ab-6e9bf4563db8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:37.995983 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-3f99525b-2754-4313-a4ab-6e9bf4563db8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:38.002596 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3f99525b-2754-4313-a4ab-6e9bf4563db8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:38.003035 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3f99525b-2754-4313-a4ab-6e9bf4563db8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:38.003870 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3f99525b-2754-4313-a4ab-6e9bf4563db8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:38.004380 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3f99525b-2754-4313-a4ab-6e9bf4563db8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:38.143885 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-3f99525b-2754-4313-a4ab-6e9bf4563db8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:38.151663 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-3f99525b-2754-4313-a4ab-6e9bf4563db8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:38.153277 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-3f99525b-2754-4313-a4ab-6e9bf4563db8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:38.154411 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-3f99525b-2754-4313-a4ab-6e9bf4563db8 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1408 microversion: 2.20 time: 0.163621 Dec 16 15:55:38.154930 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 526/986] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:55:37 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:55:39.171896 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-2cbc8f51-6aa3-4456-80cf-787058433006 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:39.172470 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-2cbc8f51-6aa3-4456-80cf-787058433006 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:39.179283 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2cbc8f51-6aa3-4456-80cf-787058433006 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:39.179720 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2cbc8f51-6aa3-4456-80cf-787058433006 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:39.180500 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2cbc8f51-6aa3-4456-80cf-787058433006 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:39.180930 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2cbc8f51-6aa3-4456-80cf-787058433006 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:39.310421 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-2cbc8f51-6aa3-4456-80cf-787058433006 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:39.320405 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-2cbc8f51-6aa3-4456-80cf-787058433006 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:39.320405 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-2cbc8f51-6aa3-4456-80cf-787058433006 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:55:39.321038 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-2cbc8f51-6aa3-4456-80cf-787058433006 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1600 microversion: 2.20 time: 0.152869 Dec 16 15:55:39.321601 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 461/987] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:55:39 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:55:39.337911 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-e16af790-a3b3-4d9f-83e0-5cfd17a01e57 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:55:39.338393 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-e16af790-a3b3-4d9f-83e0-5cfd17a01e57 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:39.344948 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e16af790-a3b3-4d9f-83e0-5cfd17a01e57 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:39.345386 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e16af790-a3b3-4d9f-83e0-5cfd17a01e57 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:39.346212 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e16af790-a3b3-4d9f-83e0-5cfd17a01e57 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:39.346638 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e16af790-a3b3-4d9f-83e0-5cfd17a01e57 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:39.450085 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-e16af790-a3b3-4d9f-83e0-5cfd17a01e57 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.115743 Dec 16 15:55:39.450703 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 527/988] 10.222.0.31 () {60 vars in 1315 bytes} [Thu Dec 16 15:55:39 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:55:40.860510 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-0f25a34a-cc80-458b-b6e6-b89174c3a610 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:55:40.862044 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-0f25a34a-cc80-458b-b6e6-b89174c3a610 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:40.868609 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-cd45e8fd-6c3e-45e0-bae9-dee4126a2c6f req-20a6741d-b879-4812-8aee-5301268c8687 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53cb08f0-26a5-4811-9df7-b5a346757838", "tag": "18769a46-6816-4b5e-bcc0-d0d8cac455d6"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:55:40.870061 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:55:40.870061 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:55:40.881087 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0f25a34a-cc80-458b-b6e6-b89174c3a610 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:40.883517 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-cd45e8fd-6c3e-45e0-bae9-dee4126a2c6f req-20a6741d-b879-4812-8aee-5301268c8687 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:40.883949 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-cd45e8fd-6c3e-45e0-bae9-dee4126a2c6f req-20a6741d-b879-4812-8aee-5301268c8687 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:40.887765 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0f25a34a-cc80-458b-b6e6-b89174c3a610 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:40.888881 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0f25a34a-cc80-458b-b6e6-b89174c3a610 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:40.889318 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0f25a34a-cc80-458b-b6e6-b89174c3a610 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:40.911311 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-cd45e8fd-6c3e-45e0-bae9-dee4126a2c6f req-20a6741d-b879-4812-8aee-5301268c8687 service nova] Creating event network-changed:18769a46-6816-4b5e-bcc0-d0d8cac455d6 for instance 53cb08f0-26a5-4811-9df7-b5a346757838 on hv-cinder-78447 Dec 16 15:55:40.918833 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-cd45e8fd-6c3e-45e0-bae9-dee4126a2c6f req-20a6741d-b879-4812-8aee-5301268c8687 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054393 Dec 16 15:55:40.920127 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 528/989] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:55:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:55:40.967233 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-0f25a34a-cc80-458b-b6e6-b89174c3a610 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 14 microversion: 2.20 time: 0.110039 Dec 16 15:55:40.970839 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 462/990] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:55:40 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:41.979909 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-2513630a-4958-4077-b0be-1005908cddb0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:55:41.980907 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-2513630a-4958-4077-b0be-1005908cddb0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:41.987442 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2513630a-4958-4077-b0be-1005908cddb0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:41.987891 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2513630a-4958-4077-b0be-1005908cddb0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:41.988673 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2513630a-4958-4077-b0be-1005908cddb0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:41.989106 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2513630a-4958-4077-b0be-1005908cddb0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:42.047167 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-2513630a-4958-4077-b0be-1005908cddb0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 14 microversion: 2.20 time: 0.071722 Dec 16 15:55:42.047766 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 529/991] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:55:41 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:43.064964 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-5d551276-a134-434f-81f0-5ce2f60e5823 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:55:43.066123 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-5d551276-a134-434f-81f0-5ce2f60e5823 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:43.073332 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5d551276-a134-434f-81f0-5ce2f60e5823 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:43.073795 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5d551276-a134-434f-81f0-5ce2f60e5823 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:43.074565 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5d551276-a134-434f-81f0-5ce2f60e5823 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:43.074989 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5d551276-a134-434f-81f0-5ce2f60e5823 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:43.138018 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-5d551276-a134-434f-81f0-5ce2f60e5823 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 14 microversion: 2.20 time: 0.081095 Dec 16 15:55:43.138639 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 463/992] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:55:43 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:44.149712 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-2efd6c9c-b9d3-4f92-8fbc-f3e68ff9994e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:55:44.150722 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-2efd6c9c-b9d3-4f92-8fbc-f3e68ff9994e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:44.158206 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2efd6c9c-b9d3-4f92-8fbc-f3e68ff9994e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:44.158723 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2efd6c9c-b9d3-4f92-8fbc-f3e68ff9994e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:44.159490 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2efd6c9c-b9d3-4f92-8fbc-f3e68ff9994e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:44.159921 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2efd6c9c-b9d3-4f92-8fbc-f3e68ff9994e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:44.235869 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-2efd6c9c-b9d3-4f92-8fbc-f3e68ff9994e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 14 microversion: 2.20 time: 0.089710 Dec 16 15:55:44.241602 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 530/993] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:55:44 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:45.249898 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-9dbcd982-adca-4c1c-ba7c-53a6048a3719 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:55:45.250894 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-9dbcd982-adca-4c1c-ba7c-53a6048a3719 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:45.258451 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9dbcd982-adca-4c1c-ba7c-53a6048a3719 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:45.258891 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9dbcd982-adca-4c1c-ba7c-53a6048a3719 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:45.259659 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9dbcd982-adca-4c1c-ba7c-53a6048a3719 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:45.260088 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9dbcd982-adca-4c1c-ba7c-53a6048a3719 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:45.335907 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-9dbcd982-adca-4c1c-ba7c-53a6048a3719 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 14 microversion: 2.20 time: 0.090000 Dec 16 15:55:45.336575 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 464/994] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:55:45 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:46.348693 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-b75218e4-f5f1-448c-8f18-15ecd5522d9a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:55:46.350019 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-b75218e4-f5f1-448c-8f18-15ecd5522d9a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:46.357862 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b75218e4-f5f1-448c-8f18-15ecd5522d9a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:46.358415 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b75218e4-f5f1-448c-8f18-15ecd5522d9a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:46.359294 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b75218e4-f5f1-448c-8f18-15ecd5522d9a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:46.359770 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b75218e4-f5f1-448c-8f18-15ecd5522d9a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:46.434558 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-b75218e4-f5f1-448c-8f18-15ecd5522d9a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 14 microversion: 2.20 time: 0.090760 Dec 16 15:55:46.435178 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 531/995] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:55:46 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:47.446485 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-8a9f6a2c-e28d-4802-a6df-fa67cf44774d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:55:47.447467 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-8a9f6a2c-e28d-4802-a6df-fa67cf44774d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:47.454466 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8a9f6a2c-e28d-4802-a6df-fa67cf44774d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:47.454919 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8a9f6a2c-e28d-4802-a6df-fa67cf44774d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:47.455697 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8a9f6a2c-e28d-4802-a6df-fa67cf44774d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:47.456123 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8a9f6a2c-e28d-4802-a6df-fa67cf44774d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:47.530799 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-8a9f6a2c-e28d-4802-a6df-fa67cf44774d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 14 microversion: 2.20 time: 0.087917 Dec 16 15:55:47.531727 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 465/996] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:55:47 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:55:48.544377 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-8c0ee728-19d6-45f3-af0a-fc5992d611c7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:55:48.545615 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-8c0ee728-19d6-45f3-af0a-fc5992d611c7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:48.554151 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8c0ee728-19d6-45f3-af0a-fc5992d611c7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:48.554603 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8c0ee728-19d6-45f3-af0a-fc5992d611c7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:48.555386 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8c0ee728-19d6-45f3-af0a-fc5992d611c7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:48.555820 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8c0ee728-19d6-45f3-af0a-fc5992d611c7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:48.618565 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-8c0ee728-19d6-45f3-af0a-fc5992d611c7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 14 microversion: 2.20 time: 0.079226 Dec 16 15:55:48.619198 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 532/997] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:55:48 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:49.630819 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-b2c99271-4f5f-42bf-baa7-7adec5dca12d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:55:49.631765 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-b2c99271-4f5f-42bf-baa7-7adec5dca12d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:49.639090 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b2c99271-4f5f-42bf-baa7-7adec5dca12d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:49.639528 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b2c99271-4f5f-42bf-baa7-7adec5dca12d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:49.640298 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b2c99271-4f5f-42bf-baa7-7adec5dca12d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:49.640723 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b2c99271-4f5f-42bf-baa7-7adec5dca12d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:49.703095 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-b2c99271-4f5f-42bf-baa7-7adec5dca12d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 14 microversion: 2.20 time: 0.076383 Dec 16 15:55:49.703684 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 466/998] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:55:49 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:50.719832 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-71c66368-ccac-4a7d-abff-b44dedf993ff tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:55:50.721488 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-71c66368-ccac-4a7d-abff-b44dedf993ff tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:50.733112 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-71c66368-ccac-4a7d-abff-b44dedf993ff tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:50.733914 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-71c66368-ccac-4a7d-abff-b44dedf993ff tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:50.735251 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-71c66368-ccac-4a7d-abff-b44dedf993ff tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:50.735968 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-71c66368-ccac-4a7d-abff-b44dedf993ff tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:50.802366 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-71c66368-ccac-4a7d-abff-b44dedf993ff tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 14 microversion: 2.20 time: 0.089828 Dec 16 15:55:50.802967 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 533/999] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:55:50 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:51.818909 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-085bd75d-d688-4601-becf-4a5b4defb1d2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:55:51.820340 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-085bd75d-d688-4601-becf-4a5b4defb1d2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:51.827630 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-085bd75d-d688-4601-becf-4a5b4defb1d2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:51.828081 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-085bd75d-d688-4601-becf-4a5b4defb1d2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:51.828867 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-085bd75d-d688-4601-becf-4a5b4defb1d2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:51.829303 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-085bd75d-d688-4601-becf-4a5b4defb1d2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:51.888513 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-085bd75d-d688-4601-becf-4a5b4defb1d2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 14 microversion: 2.20 time: 0.076538 Dec 16 15:55:51.889121 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 467/1000] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:55:51 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:55:52.900318 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-5cc4cfae-af9b-46b0-ab19-3a960cef95cc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:55:52.901343 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-5cc4cfae-af9b-46b0-ab19-3a960cef95cc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:52.908276 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5cc4cfae-af9b-46b0-ab19-3a960cef95cc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:52.908715 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5cc4cfae-af9b-46b0-ab19-3a960cef95cc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:52.909515 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5cc4cfae-af9b-46b0-ab19-3a960cef95cc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:52.909937 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5cc4cfae-af9b-46b0-ab19-3a960cef95cc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:52.982608 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-5cc4cfae-af9b-46b0-ab19-3a960cef95cc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 7546 microversion: 2.20 time: 0.086293 Dec 16 15:55:52.983342 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 534/1001] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:55:52 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 7546 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:55:53.999038 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-6d2b1c91-fb86-451e-bf05-99fb819fcb9f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:55:54.000639 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-6d2b1c91-fb86-451e-bf05-99fb819fcb9f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:54.010274 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6d2b1c91-fb86-451e-bf05-99fb819fcb9f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:54.010719 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6d2b1c91-fb86-451e-bf05-99fb819fcb9f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:54.011555 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6d2b1c91-fb86-451e-bf05-99fb819fcb9f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:54.011989 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6d2b1c91-fb86-451e-bf05-99fb819fcb9f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:54.083066 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-6d2b1c91-fb86-451e-bf05-99fb819fcb9f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 15025 microversion: 2.20 time: 0.090799 Dec 16 15:55:54.083683 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 468/1002] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:55:53 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 15025 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:55:55.096369 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-3ca5d029-7600-44e5-9f71-58f19a66da10 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:55:55.097466 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-3ca5d029-7600-44e5-9f71-58f19a66da10 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:55.104192 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3ca5d029-7600-44e5-9f71-58f19a66da10 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:55.104605 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3ca5d029-7600-44e5-9f71-58f19a66da10 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:55.105387 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3ca5d029-7600-44e5-9f71-58f19a66da10 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:55.105846 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3ca5d029-7600-44e5-9f71-58f19a66da10 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:55.176163 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-3ca5d029-7600-44e5-9f71-58f19a66da10 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 18498 microversion: 2.20 time: 0.084210 Dec 16 15:55:55.177207 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 535/1003] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:55:55 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 18498 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:55:56.188357 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-cf888274-ccda-4d32-a2d0-462801035d0d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:55:56.189296 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-cf888274-ccda-4d32-a2d0-462801035d0d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:56.197348 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cf888274-ccda-4d32-a2d0-462801035d0d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:56.197842 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cf888274-ccda-4d32-a2d0-462801035d0d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:56.198642 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cf888274-ccda-4d32-a2d0-462801035d0d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:56.199079 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cf888274-ccda-4d32-a2d0-462801035d0d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:56.279987 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-cf888274-ccda-4d32-a2d0-462801035d0d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 19774 microversion: 2.20 time: 0.095995 Dec 16 15:55:56.280664 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 469/1004] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:55:56 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 19774 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:55:57.296758 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-bbc384de-f4a6-48e1-a6ee-6b437357d179 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:55:57.298429 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-bbc384de-f4a6-48e1-a6ee-6b437357d179 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:57.308155 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-bbc384de-f4a6-48e1-a6ee-6b437357d179 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:57.308613 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-bbc384de-f4a6-48e1-a6ee-6b437357d179 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:57.309399 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-bbc384de-f4a6-48e1-a6ee-6b437357d179 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:57.309862 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-bbc384de-f4a6-48e1-a6ee-6b437357d179 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:57.377897 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-bbc384de-f4a6-48e1-a6ee-6b437357d179 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 22546 microversion: 2.20 time: 0.088015 Dec 16 15:55:57.378528 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 536/1005] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:55:57 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 22546 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:55:58.394406 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-6115e3ce-f458-47e8-9952-05f167d7830c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:55:58.395615 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-6115e3ce-f458-47e8-9952-05f167d7830c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:58.406050 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6115e3ce-f458-47e8-9952-05f167d7830c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:58.406680 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6115e3ce-f458-47e8-9952-05f167d7830c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:58.407777 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6115e3ce-f458-47e8-9952-05f167d7830c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:58.408367 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6115e3ce-f458-47e8-9952-05f167d7830c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:58.491197 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-6115e3ce-f458-47e8-9952-05f167d7830c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 23804 microversion: 2.20 time: 0.103107 Dec 16 15:55:58.492692 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 470/1006] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:55:58 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 23804 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:55:59.505037 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-6d64180a-179d-4cd0-bdd8-e7bc9efb7d75 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:55:59.506121 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-6d64180a-179d-4cd0-bdd8-e7bc9efb7d75 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:55:59.513639 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6d64180a-179d-4cd0-bdd8-e7bc9efb7d75 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:59.514105 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6d64180a-179d-4cd0-bdd8-e7bc9efb7d75 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:59.514915 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6d64180a-179d-4cd0-bdd8-e7bc9efb7d75 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:55:59.515364 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6d64180a-179d-4cd0-bdd8-e7bc9efb7d75 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:55:59.588701 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-6d64180a-179d-4cd0-bdd8-e7bc9efb7d75 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 25453 microversion: 2.20 time: 0.087472 Dec 16 15:55:59.589771 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 537/1007] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:55:59 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 25453 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:56:00.608108 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-ce2a68f0-4bc3-4974-b29f-0a0176968e44 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:56:00.609125 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-ce2a68f0-4bc3-4974-b29f-0a0176968e44 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:00.616362 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ce2a68f0-4bc3-4974-b29f-0a0176968e44 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:00.616809 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ce2a68f0-4bc3-4974-b29f-0a0176968e44 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:00.617648 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ce2a68f0-4bc3-4974-b29f-0a0176968e44 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:00.618076 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ce2a68f0-4bc3-4974-b29f-0a0176968e44 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:00.693672 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-ce2a68f0-4bc3-4974-b29f-0a0176968e44 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 26829 microversion: 2.20 time: 0.092525 Dec 16 15:56:00.694330 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 471/1008] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:56:00 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 26829 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:56:01.710491 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-52872212-bce0-404f-87f2-721ba96c2cad tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:56:01.711858 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-52872212-bce0-404f-87f2-721ba96c2cad tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:01.720382 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-52872212-bce0-404f-87f2-721ba96c2cad tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:01.720909 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-52872212-bce0-404f-87f2-721ba96c2cad tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:01.721859 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-52872212-bce0-404f-87f2-721ba96c2cad tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:01.722374 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-52872212-bce0-404f-87f2-721ba96c2cad tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:01.804652 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-52872212-bce0-404f-87f2-721ba96c2cad tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 27655 microversion: 2.20 time: 0.100718 Dec 16 15:56:01.805454 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 538/1009] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:56:01 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 27655 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:56:02.821606 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-91a1828c-1f84-4a6b-83df-7d977b6ac244 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:56:02.822611 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-91a1828c-1f84-4a6b-83df-7d977b6ac244 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:02.829999 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-91a1828c-1f84-4a6b-83df-7d977b6ac244 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:02.830442 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-91a1828c-1f84-4a6b-83df-7d977b6ac244 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:02.831221 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-91a1828c-1f84-4a6b-83df-7d977b6ac244 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:02.831660 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-91a1828c-1f84-4a6b-83df-7d977b6ac244 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:02.907296 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-91a1828c-1f84-4a6b-83df-7d977b6ac244 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 28185 microversion: 2.20 time: 0.091723 Dec 16 15:56:02.907920 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 472/1010] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:56:02 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 28185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:56:03.924310 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-5cd95e48-5a5a-466a-9789-a9530b09fd97 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:56:03.925999 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-5cd95e48-5a5a-466a-9789-a9530b09fd97 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:03.934833 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5cd95e48-5a5a-466a-9789-a9530b09fd97 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:03.935282 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5cd95e48-5a5a-466a-9789-a9530b09fd97 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:03.936084 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5cd95e48-5a5a-466a-9789-a9530b09fd97 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:03.936494 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5cd95e48-5a5a-466a-9789-a9530b09fd97 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:03.999425 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-5cd95e48-5a5a-466a-9789-a9530b09fd97 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 28185 microversion: 2.20 time: 0.081593 Dec 16 15:56:04.000401 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 539/1011] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:56:03 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 28185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:56:05.015853 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-63a34c70-e524-44c3-9dc8-911307b1a013 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:56:05.016940 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-63a34c70-e524-44c3-9dc8-911307b1a013 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:05.024599 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-63a34c70-e524-44c3-9dc8-911307b1a013 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:05.025071 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-63a34c70-e524-44c3-9dc8-911307b1a013 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:05.025929 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-63a34c70-e524-44c3-9dc8-911307b1a013 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:05.026379 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-63a34c70-e524-44c3-9dc8-911307b1a013 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:05.104896 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-63a34c70-e524-44c3-9dc8-911307b1a013 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 28476 microversion: 2.20 time: 0.092969 Dec 16 15:56:05.105897 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 473/1012] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:56:05 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 28476 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:56:06.123418 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-929b9b3c-e780-4e8f-8d13-13817aa0f9bf tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:56:06.124458 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-929b9b3c-e780-4e8f-8d13-13817aa0f9bf tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:06.131991 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-929b9b3c-e780-4e8f-8d13-13817aa0f9bf tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:06.132481 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-929b9b3c-e780-4e8f-8d13-13817aa0f9bf tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:06.133262 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-929b9b3c-e780-4e8f-8d13-13817aa0f9bf tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:06.133743 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-929b9b3c-e780-4e8f-8d13-13817aa0f9bf tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:06.211953 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-929b9b3c-e780-4e8f-8d13-13817aa0f9bf tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 28644 microversion: 2.20 time: 0.094007 Dec 16 15:56:06.212951 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 540/1013] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:56:06 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 28644 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:56:07.231519 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-6cad8e4a-6593-483e-b821-8a4627a98b7b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:56:07.232707 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-6cad8e4a-6593-483e-b821-8a4627a98b7b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:07.241033 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6cad8e4a-6593-483e-b821-8a4627a98b7b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:07.241613 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6cad8e4a-6593-483e-b821-8a4627a98b7b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:07.242511 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6cad8e4a-6593-483e-b821-8a4627a98b7b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:07.243010 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-6cad8e4a-6593-483e-b821-8a4627a98b7b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:07.304019 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-6cad8e4a-6593-483e-b821-8a4627a98b7b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 28644 microversion: 2.20 time: 0.079268 Dec 16 15:56:07.304630 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 474/1014] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:56:07 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 28644 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:56:08.320901 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-da198e39-b57c-41a7-afa0-235c1bfe87fc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:56:08.322568 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-da198e39-b57c-41a7-afa0-235c1bfe87fc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:08.333920 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-da198e39-b57c-41a7-afa0-235c1bfe87fc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:08.334680 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-da198e39-b57c-41a7-afa0-235c1bfe87fc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:08.335977 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-da198e39-b57c-41a7-afa0-235c1bfe87fc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:08.336704 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-da198e39-b57c-41a7-afa0-235c1bfe87fc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:08.402054 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-da198e39-b57c-41a7-afa0-235c1bfe87fc tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 28644 microversion: 2.20 time: 0.087948 Dec 16 15:56:08.402554 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 541/1015] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:56:08 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 28644 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:56:09.420460 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-e47e4645-01d6-4fcb-a57c-a7185dd73942 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:56:09.421451 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-e47e4645-01d6-4fcb-a57c-a7185dd73942 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:09.428653 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e47e4645-01d6-4fcb-a57c-a7185dd73942 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:09.429096 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e47e4645-01d6-4fcb-a57c-a7185dd73942 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:09.429906 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e47e4645-01d6-4fcb-a57c-a7185dd73942 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:09.430333 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e47e4645-01d6-4fcb-a57c-a7185dd73942 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:09.508105 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-e47e4645-01d6-4fcb-a57c-a7185dd73942 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 28766 microversion: 2.20 time: 0.094587 Dec 16 15:56:09.508758 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 475/1016] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:56:09 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 28766 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:56:10.520565 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-79625457-6f64-4f47-9513-9787dada191d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:56:10.521607 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-79625457-6f64-4f47-9513-9787dada191d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:10.529040 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-79625457-6f64-4f47-9513-9787dada191d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:10.529527 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-79625457-6f64-4f47-9513-9787dada191d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:10.530446 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-79625457-6f64-4f47-9513-9787dada191d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:10.530864 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-79625457-6f64-4f47-9513-9787dada191d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:10.606775 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-79625457-6f64-4f47-9513-9787dada191d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 30874 microversion: 2.20 time: 0.089748 Dec 16 15:56:10.607782 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 542/1017] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:56:10 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 30874 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:56:11.626052 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-a3db9ea8-b8a8-4e71-a0b9-9e5a5a6216a3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:56:11.627647 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-a3db9ea8-b8a8-4e71-a0b9-9e5a5a6216a3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:11.639319 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a3db9ea8-b8a8-4e71-a0b9-9e5a5a6216a3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:11.639984 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a3db9ea8-b8a8-4e71-a0b9-9e5a5a6216a3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:11.640764 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a3db9ea8-b8a8-4e71-a0b9-9e5a5a6216a3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:11.641185 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a3db9ea8-b8a8-4e71-a0b9-9e5a5a6216a3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:11.715099 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-a3db9ea8-b8a8-4e71-a0b9-9e5a5a6216a3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 32758 microversion: 2.20 time: 0.095368 Dec 16 15:56:11.716091 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 476/1018] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:56:11 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 32758 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:56:12.733337 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-1d93aace-dc94-46b2-ac90-1a22f5f8b3f6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:56:12.734974 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-1d93aace-dc94-46b2-ac90-1a22f5f8b3f6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:12.746279 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1d93aace-dc94-46b2-ac90-1a22f5f8b3f6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:12.747005 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1d93aace-dc94-46b2-ac90-1a22f5f8b3f6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:12.748276 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1d93aace-dc94-46b2-ac90-1a22f5f8b3f6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:12.749065 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-1d93aace-dc94-46b2-ac90-1a22f5f8b3f6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:12.826559 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-1d93aace-dc94-46b2-ac90-1a22f5f8b3f6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 33751 microversion: 2.20 time: 0.099930 Dec 16 15:56:12.827260 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 543/1019] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:56:12 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 33751 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:56:13.840451 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-d91a18ea-8cb1-43e0-9ad3-539b9422db69 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:56:13.841519 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-d91a18ea-8cb1-43e0-9ad3-539b9422db69 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:13.851148 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d91a18ea-8cb1-43e0-9ad3-539b9422db69 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:13.851730 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d91a18ea-8cb1-43e0-9ad3-539b9422db69 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:13.852912 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d91a18ea-8cb1-43e0-9ad3-539b9422db69 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:13.853556 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d91a18ea-8cb1-43e0-9ad3-539b9422db69 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:13.926125 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-d91a18ea-8cb1-43e0-9ad3-539b9422db69 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 34921 microversion: 2.20 time: 0.089669 Dec 16 15:56:13.926766 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 477/1020] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:56:13 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 34921 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:56:14.943674 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-a90293e1-b57e-4e1d-b65d-8196f5ea496a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:56:14.945366 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-a90293e1-b57e-4e1d-b65d-8196f5ea496a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:14.956787 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a90293e1-b57e-4e1d-b65d-8196f5ea496a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:14.957580 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a90293e1-b57e-4e1d-b65d-8196f5ea496a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:14.958850 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a90293e1-b57e-4e1d-b65d-8196f5ea496a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:14.959558 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a90293e1-b57e-4e1d-b65d-8196f5ea496a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:15.042008 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-a90293e1-b57e-4e1d-b65d-8196f5ea496a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 36257 microversion: 2.20 time: 0.105457 Dec 16 15:56:15.042642 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 544/1021] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:56:14 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 36257 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:56:16.059369 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-81b752ef-1a0e-4553-b5e4-70210b188617 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:56:16.061077 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-81b752ef-1a0e-4553-b5e4-70210b188617 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:16.072694 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-81b752ef-1a0e-4553-b5e4-70210b188617 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:16.073462 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-81b752ef-1a0e-4553-b5e4-70210b188617 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:16.074758 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-81b752ef-1a0e-4553-b5e4-70210b188617 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:16.075477 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-81b752ef-1a0e-4553-b5e4-70210b188617 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:16.158444 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-81b752ef-1a0e-4553-b5e4-70210b188617 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 37917 microversion: 2.20 time: 0.106358 Dec 16 15:56:16.159080 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 478/1022] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:56:16 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 37917 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:56:17.175669 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ccd2d2b2-bdc8-4dc9-b725-527880d21da7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:56:17.177299 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-ccd2d2b2-bdc8-4dc9-b725-527880d21da7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:17.188908 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ccd2d2b2-bdc8-4dc9-b725-527880d21da7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:17.189361 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ccd2d2b2-bdc8-4dc9-b725-527880d21da7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:17.190180 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ccd2d2b2-bdc8-4dc9-b725-527880d21da7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:17.190619 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ccd2d2b2-bdc8-4dc9-b725-527880d21da7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:17.275648 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-ccd2d2b2-bdc8-4dc9-b725-527880d21da7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 38203 microversion: 2.20 time: 0.106454 Dec 16 15:56:17.276660 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 545/1023] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:56:17 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 38203 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:56:18.295198 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-9cb59a36-aa94-4bb7-9019-47915b8096b7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:56:18.296833 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-9cb59a36-aa94-4bb7-9019-47915b8096b7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:18.304626 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9cb59a36-aa94-4bb7-9019-47915b8096b7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:18.305072 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9cb59a36-aa94-4bb7-9019-47915b8096b7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:18.305892 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9cb59a36-aa94-4bb7-9019-47915b8096b7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:18.306326 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9cb59a36-aa94-4bb7-9019-47915b8096b7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:18.368200 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-9cb59a36-aa94-4bb7-9019-47915b8096b7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 38203 microversion: 2.20 time: 0.079903 Dec 16 15:56:18.368822 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 479/1024] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:56:18 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 38203 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:56:19.381028 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-2bc876c3-0abd-446c-9468-d5bb6a967799 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:56:19.382045 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-2bc876c3-0abd-446c-9468-d5bb6a967799 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:19.389791 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2bc876c3-0abd-446c-9468-d5bb6a967799 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:19.390248 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2bc876c3-0abd-446c-9468-d5bb6a967799 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:19.391034 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2bc876c3-0abd-446c-9468-d5bb6a967799 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:19.391469 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2bc876c3-0abd-446c-9468-d5bb6a967799 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:19.454161 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-2bc876c3-0abd-446c-9468-d5bb6a967799 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 38203 microversion: 2.20 time: 0.077264 Dec 16 15:56:19.454780 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 546/1025] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:56:19 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 38203 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:56:20.471895 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-d65e81fa-4e91-4b55-8741-abb1e5cc7d04 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:56:20.473381 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-d65e81fa-4e91-4b55-8741-abb1e5cc7d04 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:20.485053 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d65e81fa-4e91-4b55-8741-abb1e5cc7d04 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:20.485848 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d65e81fa-4e91-4b55-8741-abb1e5cc7d04 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:20.486631 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d65e81fa-4e91-4b55-8741-abb1e5cc7d04 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:20.487058 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d65e81fa-4e91-4b55-8741-abb1e5cc7d04 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:20.563614 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-d65e81fa-4e91-4b55-8741-abb1e5cc7d04 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 200 len: 38346 microversion: 2.20 time: 0.098777 Dec 16 15:56:20.564631 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 480/1026] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:56:20 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 38346 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:56:20.580853 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-a096ef6a-889c-498b-8455-241414d68d60 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:20.581426 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-a096ef6a-889c-498b-8455-241414d68d60 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:20.588799 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a096ef6a-889c-498b-8455-241414d68d60 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:20.589256 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a096ef6a-889c-498b-8455-241414d68d60 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:20.590078 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a096ef6a-889c-498b-8455-241414d68d60 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:20.590515 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a096ef6a-889c-498b-8455-241414d68d60 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:20.614898 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-a096ef6a-889c-498b-8455-241414d68d60 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/ips" status: 200 len: 152 microversion: 2.20 time: 0.040262 Dec 16 15:56:20.615463 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 547/1027] 10.222.0.31 () {60 vars in 1288 bytes} [Thu Dec 16 15:56:20 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:56:22.644420 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-d9ec78f1-66c8-4ffb-a788-bc1b905c85ac tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:56:22.644951 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-d9ec78f1-66c8-4ffb-a788-bc1b905c85ac tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:22.652117 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d9ec78f1-66c8-4ffb-a788-bc1b905c85ac tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:22.652621 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d9ec78f1-66c8-4ffb-a788-bc1b905c85ac tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:22.653387 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d9ec78f1-66c8-4ffb-a788-bc1b905c85ac tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:22.653841 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d9ec78f1-66c8-4ffb-a788-bc1b905c85ac tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:22.677515 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.objects.instance [None req-d9ec78f1-66c8-4ffb-a788-bc1b905c85ac tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lazy-loading 'flavor' on Instance uuid 53cb08f0-26a5-4811-9df7-b5a346757838 {{(pid=122398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:56:22.954987 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-d9ec78f1-66c8-4ffb-a788-bc1b905c85ac tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 202 len: 0 microversion: 2.20 time: 0.315947 Dec 16 15:56:22.955614 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 481/1028] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:56:22 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:56:22.963781 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-d6f6358d-ef4d-4edf-a3be-902bd82dfe5d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:22.964508 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-d6f6358d-ef4d-4edf-a3be-902bd82dfe5d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:22.971567 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d6f6358d-ef4d-4edf-a3be-902bd82dfe5d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:22.972339 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d6f6358d-ef4d-4edf-a3be-902bd82dfe5d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:22.973115 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d6f6358d-ef4d-4edf-a3be-902bd82dfe5d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:22.973575 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d6f6358d-ef4d-4edf-a3be-902bd82dfe5d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:23.122401 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-d6f6358d-ef4d-4edf-a3be-902bd82dfe5d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:23.130957 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-d6f6358d-ef4d-4edf-a3be-902bd82dfe5d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:23.132476 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-d6f6358d-ef4d-4edf-a3be-902bd82dfe5d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:23.133671 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-d6f6358d-ef4d-4edf-a3be-902bd82dfe5d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1725 microversion: 2.20 time: 0.173655 Dec 16 15:56:23.134314 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 548/1029] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:56:22 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:56:24.158282 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-f6cae0fb-4ee5-476a-a658-4939b62b7be2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:24.159415 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-f6cae0fb-4ee5-476a-a658-4939b62b7be2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:24.170055 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f6cae0fb-4ee5-476a-a658-4939b62b7be2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:24.170783 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f6cae0fb-4ee5-476a-a658-4939b62b7be2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:24.172053 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f6cae0fb-4ee5-476a-a658-4939b62b7be2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:24.172828 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f6cae0fb-4ee5-476a-a658-4939b62b7be2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:24.306361 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-f6cae0fb-4ee5-476a-a658-4939b62b7be2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:24.318110 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-f6cae0fb-4ee5-476a-a658-4939b62b7be2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:24.320327 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-f6cae0fb-4ee5-476a-a658-4939b62b7be2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:24.322044 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-f6cae0fb-4ee5-476a-a658-4939b62b7be2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1725 microversion: 2.20 time: 0.171279 Dec 16 15:56:24.322807 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 482/1030] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:56:24 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:56:25.347222 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-f97a871d-bd3b-44a4-af92-b26cd3b424f7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:25.348304 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-f97a871d-bd3b-44a4-af92-b26cd3b424f7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:25.358735 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f97a871d-bd3b-44a4-af92-b26cd3b424f7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:25.359469 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f97a871d-bd3b-44a4-af92-b26cd3b424f7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:25.360739 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f97a871d-bd3b-44a4-af92-b26cd3b424f7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:25.361469 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f97a871d-bd3b-44a4-af92-b26cd3b424f7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:25.510993 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-f97a871d-bd3b-44a4-af92-b26cd3b424f7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:25.519155 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-f97a871d-bd3b-44a4-af92-b26cd3b424f7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:25.520620 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-f97a871d-bd3b-44a4-af92-b26cd3b424f7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:25.521843 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-f97a871d-bd3b-44a4-af92-b26cd3b424f7 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1725 microversion: 2.20 time: 0.181292 Dec 16 15:56:25.522422 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 549/1031] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:56:25 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:56:26.543765 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-4ab6873e-6a11-413a-8e71-a4d62f3bb416 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:26.544863 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-4ab6873e-6a11-413a-8e71-a4d62f3bb416 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:26.556129 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4ab6873e-6a11-413a-8e71-a4d62f3bb416 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:26.556868 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4ab6873e-6a11-413a-8e71-a4d62f3bb416 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:26.558340 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4ab6873e-6a11-413a-8e71-a4d62f3bb416 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:26.559150 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4ab6873e-6a11-413a-8e71-a4d62f3bb416 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:26.696038 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-4ab6873e-6a11-413a-8e71-a4d62f3bb416 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:26.703847 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-4ab6873e-6a11-413a-8e71-a4d62f3bb416 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:26.705335 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-4ab6873e-6a11-413a-8e71-a4d62f3bb416 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:26.706625 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-4ab6873e-6a11-413a-8e71-a4d62f3bb416 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1725 microversion: 2.20 time: 0.169313 Dec 16 15:56:26.707168 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 483/1032] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:56:26 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:56:27.728612 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-8c4c2b07-872e-468e-b3ac-9102db86a8b3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:27.729704 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-8c4c2b07-872e-468e-b3ac-9102db86a8b3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:27.739125 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8c4c2b07-872e-468e-b3ac-9102db86a8b3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:27.739577 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8c4c2b07-872e-468e-b3ac-9102db86a8b3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:27.740361 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8c4c2b07-872e-468e-b3ac-9102db86a8b3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:27.740795 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8c4c2b07-872e-468e-b3ac-9102db86a8b3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:27.883187 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-8c4c2b07-872e-468e-b3ac-9102db86a8b3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:27.895333 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-8c4c2b07-872e-468e-b3ac-9102db86a8b3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:27.897808 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-8c4c2b07-872e-468e-b3ac-9102db86a8b3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:27.899591 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-8c4c2b07-872e-468e-b3ac-9102db86a8b3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1725 microversion: 2.20 time: 0.176968 Dec 16 15:56:27.900382 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 550/1033] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:56:27 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:56:28.923968 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-e090eb69-3b7e-447d-819f-4c9b9462e355 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:28.925013 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-e090eb69-3b7e-447d-819f-4c9b9462e355 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:28.934826 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e090eb69-3b7e-447d-819f-4c9b9462e355 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:28.935515 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e090eb69-3b7e-447d-819f-4c9b9462e355 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:28.936807 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e090eb69-3b7e-447d-819f-4c9b9462e355 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:28.937491 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-e090eb69-3b7e-447d-819f-4c9b9462e355 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:29.082734 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-e090eb69-3b7e-447d-819f-4c9b9462e355 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:29.091567 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-e090eb69-3b7e-447d-819f-4c9b9462e355 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:29.093564 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-e090eb69-3b7e-447d-819f-4c9b9462e355 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:29.094749 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-e090eb69-3b7e-447d-819f-4c9b9462e355 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1725 microversion: 2.20 time: 0.177074 Dec 16 15:56:29.097918 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 484/1034] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:56:28 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:56:30.116497 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-b1546e8b-3172-4d70-ae47-3702726c5859 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:30.117153 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-b1546e8b-3172-4d70-ae47-3702726c5859 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:30.123678 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b1546e8b-3172-4d70-ae47-3702726c5859 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:30.124128 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b1546e8b-3172-4d70-ae47-3702726c5859 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:30.124909 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b1546e8b-3172-4d70-ae47-3702726c5859 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:30.125343 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b1546e8b-3172-4d70-ae47-3702726c5859 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:30.267258 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-b1546e8b-3172-4d70-ae47-3702726c5859 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:30.275529 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-b1546e8b-3172-4d70-ae47-3702726c5859 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:30.277367 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-b1546e8b-3172-4d70-ae47-3702726c5859 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:30.278435 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-b1546e8b-3172-4d70-ae47-3702726c5859 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1725 microversion: 2.20 time: 0.167348 Dec 16 15:56:30.279030 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 551/1035] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:56:30 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:56:31.306252 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-1995d5f8-3b65-49ea-a070-e3e2035e19ff tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:31.307188 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-1995d5f8-3b65-49ea-a070-e3e2035e19ff tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:31.317919 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1995d5f8-3b65-49ea-a070-e3e2035e19ff tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:31.318522 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1995d5f8-3b65-49ea-a070-e3e2035e19ff tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:31.319307 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1995d5f8-3b65-49ea-a070-e3e2035e19ff tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:31.319733 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1995d5f8-3b65-49ea-a070-e3e2035e19ff tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:31.463662 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-1995d5f8-3b65-49ea-a070-e3e2035e19ff tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:31.476724 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-1995d5f8-3b65-49ea-a070-e3e2035e19ff tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:31.478471 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-1995d5f8-3b65-49ea-a070-e3e2035e19ff tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:31.479632 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-1995d5f8-3b65-49ea-a070-e3e2035e19ff tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1725 microversion: 2.20 time: 0.179852 Dec 16 15:56:31.480197 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 485/1036] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:56:31 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:56:32.502165 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-109574d9-76cd-43c0-9bbe-e303e5a15610 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:32.503504 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-109574d9-76cd-43c0-9bbe-e303e5a15610 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:32.511044 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-109574d9-76cd-43c0-9bbe-e303e5a15610 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:32.511494 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-109574d9-76cd-43c0-9bbe-e303e5a15610 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:32.512266 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-109574d9-76cd-43c0-9bbe-e303e5a15610 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:32.512695 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-109574d9-76cd-43c0-9bbe-e303e5a15610 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:32.646491 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-109574d9-76cd-43c0-9bbe-e303e5a15610 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:32.658208 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-109574d9-76cd-43c0-9bbe-e303e5a15610 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:32.660410 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-109574d9-76cd-43c0-9bbe-e303e5a15610 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:32.662201 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-109574d9-76cd-43c0-9bbe-e303e5a15610 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1725 microversion: 2.20 time: 0.164939 Dec 16 15:56:32.662890 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 552/1037] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:56:32 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:56:33.684528 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-826b1372-1ca4-4867-aa98-add1f9c1c31e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:33.685135 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-826b1372-1ca4-4867-aa98-add1f9c1c31e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:33.691877 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-826b1372-1ca4-4867-aa98-add1f9c1c31e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:33.692323 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-826b1372-1ca4-4867-aa98-add1f9c1c31e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:33.693066 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-826b1372-1ca4-4867-aa98-add1f9c1c31e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:33.693564 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-826b1372-1ca4-4867-aa98-add1f9c1c31e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:33.829544 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-826b1372-1ca4-4867-aa98-add1f9c1c31e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:33.837824 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-826b1372-1ca4-4867-aa98-add1f9c1c31e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:33.839302 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-826b1372-1ca4-4867-aa98-add1f9c1c31e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:33.840511 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-826b1372-1ca4-4867-aa98-add1f9c1c31e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1746 microversion: 2.20 time: 0.160804 Dec 16 15:56:33.841069 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 486/1038] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:56:33 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:56:34.859353 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-f6145131-5fd7-4f63-9f63-15ad17697abe tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:34.859965 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-f6145131-5fd7-4f63-9f63-15ad17697abe tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:34.866628 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f6145131-5fd7-4f63-9f63-15ad17697abe tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:34.867048 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f6145131-5fd7-4f63-9f63-15ad17697abe tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:34.868069 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f6145131-5fd7-4f63-9f63-15ad17697abe tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:34.868501 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f6145131-5fd7-4f63-9f63-15ad17697abe tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:35.097074 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-f6145131-5fd7-4f63-9f63-15ad17697abe tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:35.105336 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-f6145131-5fd7-4f63-9f63-15ad17697abe tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:35.106872 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-f6145131-5fd7-4f63-9f63-15ad17697abe tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:35.108149 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-f6145131-5fd7-4f63-9f63-15ad17697abe tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1746 microversion: 2.20 time: 0.252649 Dec 16 15:56:35.108918 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 553/1039] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:56:34 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1746 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:56:35.352247 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-77209b15-a0a8-4ffa-9f38-6e036ed1659a tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:35.353329 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-77209b15-a0a8-4ffa-9f38-6e036ed1659a tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:35.355434 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-d3957977-bc45-468b-ba9b-7a38517218f0 req-0f839812-c1f8-417d-ac21-a5a5aa04bfff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "248b8eac-f030-4761-a6c9-0ddaf6475f0f", "tag": "8e2fdbb4-3edf-41eb-8daa-904ea54bacb1"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:56:35.357155 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:56:35.357155 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:56:35.359564 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-77209b15-a0a8-4ffa-9f38-6e036ed1659a tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:35.360038 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-77209b15-a0a8-4ffa-9f38-6e036ed1659a tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:35.360821 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-77209b15-a0a8-4ffa-9f38-6e036ed1659a tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:35.361209 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-77209b15-a0a8-4ffa-9f38-6e036ed1659a tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:35.368421 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-d3957977-bc45-468b-ba9b-7a38517218f0 req-0f839812-c1f8-417d-ac21-a5a5aa04bfff service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:35.368870 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-d3957977-bc45-468b-ba9b-7a38517218f0 req-0f839812-c1f8-417d-ac21-a5a5aa04bfff service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:35.386150 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-77209b15-a0a8-4ffa-9f38-6e036ed1659a tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Going to try to terminate instance {{(pid=122398) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 15:56:35.400715 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-d3957977-bc45-468b-ba9b-7a38517218f0 req-0f839812-c1f8-417d-ac21-a5a5aa04bfff service nova] Creating event network-changed:8e2fdbb4-3edf-41eb-8daa-904ea54bacb1 for instance 248b8eac-f030-4761-a6c9-0ddaf6475f0f on hv-cinder-78447 Dec 16 15:56:35.419403 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-d3957977-bc45-468b-ba9b-7a38517218f0 req-0f839812-c1f8-417d-ac21-a5a5aa04bfff service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067553 Dec 16 15:56:35.420258 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 554/1040] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:56:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:56:35.488642 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-77209b15-a0a8-4ffa-9f38-6e036ed1659a tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "DELETE /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 204 len: 0 microversion: 2.1 time: 0.139335 Dec 16 15:56:35.492263 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 487/1041] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Dec 16 15:56:35 2021] DELETE /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:56:35.503157 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-24571858-a3dd-47b3-9976-7dec53b652c5 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:35.503878 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-24571858-a3dd-47b3-9976-7dec53b652c5 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:35.517182 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-24571858-a3dd-47b3-9976-7dec53b652c5 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:35.517683 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-24571858-a3dd-47b3-9976-7dec53b652c5 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:35.518499 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-24571858-a3dd-47b3-9976-7dec53b652c5 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:35.518937 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-24571858-a3dd-47b3-9976-7dec53b652c5 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:35.674764 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-24571858-a3dd-47b3-9976-7dec53b652c5 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:35.686065 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-24571858-a3dd-47b3-9976-7dec53b652c5 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1569 microversion: 2.1 time: 0.191632 Dec 16 15:56:35.686969 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 555/1042] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:56:35 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1569 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:56:36.127146 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-9ea6173b-9662-4a69-9c11-59611865dbd4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:36.128413 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-9ea6173b-9662-4a69-9c11-59611865dbd4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:36.138193 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9ea6173b-9662-4a69-9c11-59611865dbd4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:36.138816 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9ea6173b-9662-4a69-9c11-59611865dbd4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:36.139707 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9ea6173b-9662-4a69-9c11-59611865dbd4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:36.140405 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9ea6173b-9662-4a69-9c11-59611865dbd4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:36.308587 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-9ea6173b-9662-4a69-9c11-59611865dbd4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:36.323767 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-9ea6173b-9662-4a69-9c11-59611865dbd4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:36.325966 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-9ea6173b-9662-4a69-9c11-59611865dbd4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:36.327707 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-9ea6173b-9662-4a69-9c11-59611865dbd4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1741 microversion: 2.20 time: 0.204836 Dec 16 15:56:36.329077 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 488/1043] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:56:36 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1741 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:56:36.703523 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-209aa13a-6e58-4028-9293-d02d33531d3b tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:36.704934 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-209aa13a-6e58-4028-9293-d02d33531d3b tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:36.712437 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-209aa13a-6e58-4028-9293-d02d33531d3b tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:36.713033 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-209aa13a-6e58-4028-9293-d02d33531d3b tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:36.714002 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-209aa13a-6e58-4028-9293-d02d33531d3b tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:36.714669 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-209aa13a-6e58-4028-9293-d02d33531d3b tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:36.868469 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-209aa13a-6e58-4028-9293-d02d33531d3b tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:36.876859 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-209aa13a-6e58-4028-9293-d02d33531d3b tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1450 microversion: 2.1 time: 0.177092 Dec 16 15:56:36.877714 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 556/1044] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:56:36 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1450 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:56:37.198997 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-bbbf8c8e-f6c3-47a3-9d3c-1af22f9c923d req-87d88e58-ddf6-4d26-9e3d-565ba84d05cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53cb08f0-26a5-4811-9df7-b5a346757838", "name": "network-vif-plugged", "status": "completed", "tag": "18769a46-6816-4b5e-bcc0-d0d8cac455d6"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:56:37.200597 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:56:37.200597 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:56:37.214766 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-bbbf8c8e-f6c3-47a3-9d3c-1af22f9c923d req-87d88e58-ddf6-4d26-9e3d-565ba84d05cf service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:37.215204 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-bbbf8c8e-f6c3-47a3-9d3c-1af22f9c923d req-87d88e58-ddf6-4d26-9e3d-565ba84d05cf service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:37.227579 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-bbbf8c8e-f6c3-47a3-9d3c-1af22f9c923d req-87d88e58-ddf6-4d26-9e3d-565ba84d05cf service nova] Creating event network-vif-plugged:18769a46-6816-4b5e-bcc0-d0d8cac455d6 for instance 53cb08f0-26a5-4811-9df7-b5a346757838 on hv-cinder-78447 Dec 16 15:56:37.235893 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-bbbf8c8e-f6c3-47a3-9d3c-1af22f9c923d req-87d88e58-ddf6-4d26-9e3d-565ba84d05cf service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040463 Dec 16 15:56:37.237087 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 489/1045] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:56:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:56:37.349720 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ab5c79c3-f50e-4ace-820c-e8286355007e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:37.350420 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-ab5c79c3-f50e-4ace-820c-e8286355007e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:37.364287 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ab5c79c3-f50e-4ace-820c-e8286355007e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:37.364889 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ab5c79c3-f50e-4ace-820c-e8286355007e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:37.365704 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ab5c79c3-f50e-4ace-820c-e8286355007e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:37.373034 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ab5c79c3-f50e-4ace-820c-e8286355007e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:37.549038 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-ab5c79c3-f50e-4ace-820c-e8286355007e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:37.561836 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-ab5c79c3-f50e-4ace-820c-e8286355007e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:37.563510 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-ab5c79c3-f50e-4ace-820c-e8286355007e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:37.564795 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-ab5c79c3-f50e-4ace-820c-e8286355007e tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1741 microversion: 2.20 time: 0.220872 Dec 16 15:56:37.565761 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 557/1046] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:56:37 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1741 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:56:37.763429 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-6f345152-e86b-4202-a953-8a62aa6bea6e req-25a43a89-3b4b-4ff6-b1ff-be8fe70de820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "248b8eac-f030-4761-a6c9-0ddaf6475f0f", "name": "network-vif-deleted", "tag": "8e2fdbb4-3edf-41eb-8daa-904ea54bacb1"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:56:37.764901 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:56:37.764901 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:56:37.775137 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-6f345152-e86b-4202-a953-8a62aa6bea6e req-25a43a89-3b4b-4ff6-b1ff-be8fe70de820 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:37.776005 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-6f345152-e86b-4202-a953-8a62aa6bea6e req-25a43a89-3b4b-4ff6-b1ff-be8fe70de820 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:37.787633 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-6f345152-e86b-4202-a953-8a62aa6bea6e req-25a43a89-3b4b-4ff6-b1ff-be8fe70de820 service nova] Creating event network-vif-deleted:8e2fdbb4-3edf-41eb-8daa-904ea54bacb1 for instance 248b8eac-f030-4761-a6c9-0ddaf6475f0f on hv-cinder-78447 Dec 16 15:56:37.794585 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-6f345152-e86b-4202-a953-8a62aa6bea6e req-25a43a89-3b4b-4ff6-b1ff-be8fe70de820 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035073 Dec 16 15:56:37.796091 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 490/1047] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:56:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:56:37.895145 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-dc2cc0d5-ebfe-4ca8-96b4-fe843f1f3777 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:37.895775 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-dc2cc0d5-ebfe-4ca8-96b4-fe843f1f3777 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:37.902510 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-dc2cc0d5-ebfe-4ca8-96b4-fe843f1f3777 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:37.903340 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-dc2cc0d5-ebfe-4ca8-96b4-fe843f1f3777 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:37.904355 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-dc2cc0d5-ebfe-4ca8-96b4-fe843f1f3777 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:37.904993 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-dc2cc0d5-ebfe-4ca8-96b4-fe843f1f3777 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:37.974540 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-dc2cc0d5-ebfe-4ca8-96b4-fe843f1f3777 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f0340818bf4c5a94fa2ae5c4073625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34de311402354bb6a5903e764e3a0cbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:37.984058 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-dc2cc0d5-ebfe-4ca8-96b4-fe843f1f3777 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 200 len: 1220 microversion: 2.1 time: 0.093061 Dec 16 15:56:37.995102 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 558/1048] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:56:37 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:56:38.583435 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-77ee9421-3ed8-45c9-9cee-33ad5ba42217 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:38.585111 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-77ee9421-3ed8-45c9-9cee-33ad5ba42217 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:38.592916 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-77ee9421-3ed8-45c9-9cee-33ad5ba42217 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:38.593902 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-77ee9421-3ed8-45c9-9cee-33ad5ba42217 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:38.594926 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-77ee9421-3ed8-45c9-9cee-33ad5ba42217 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:38.595530 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-77ee9421-3ed8-45c9-9cee-33ad5ba42217 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:38.750189 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-77ee9421-3ed8-45c9-9cee-33ad5ba42217 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:38.757992 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-77ee9421-3ed8-45c9-9cee-33ad5ba42217 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:38.759689 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-77ee9421-3ed8-45c9-9cee-33ad5ba42217 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:38.760846 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-77ee9421-3ed8-45c9-9cee-33ad5ba42217 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1741 microversion: 2.20 time: 0.182087 Dec 16 15:56:38.761769 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 491/1049] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:56:38 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1741 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:56:39.002127 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-35ee3be1-4bd7-421d-b857-c232240b5df1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:39.003585 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-35ee3be1-4bd7-421d-b857-c232240b5df1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] [instance: 248b8eac-f030-4761-a6c9-0ddaf6475f0f] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:39.011740 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-35ee3be1-4bd7-421d-b857-c232240b5df1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:39.012282 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-35ee3be1-4bd7-421d-b857-c232240b5df1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:39.013238 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-35ee3be1-4bd7-421d-b857-c232240b5df1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:39.013970 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-35ee3be1-4bd7-421d-b857-c232240b5df1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:39.032673 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.wsgi [None req-35ee3be1-4bd7-421d-b857-c232240b5df1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] HTTP exception thrown: Instance 248b8eac-f030-4761-a6c9-0ddaf6475f0f could not be found. Dec 16 15:56:39.033270 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-35ee3be1-4bd7-421d-b857-c232240b5df1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Returning 404 to user: Instance 248b8eac-f030-4761-a6c9-0ddaf6475f0f could not be found. {{(pid=122399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:56:39.034320 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-35ee3be1-4bd7-421d-b857-c232240b5df1 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f" status: 404 len: 111 microversion: 2.1 time: 0.035970 Dec 16 15:56:39.034880 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 559/1050] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:56:38 2021] GET /compute/v2.1/servers/248b8eac-f030-4761-a6c9-0ddaf6475f0f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:56:39.220714 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-be5f8042-52f0-4930-af06-114b421c87a9 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] Calling method '.version_select at 0x7fed5de3fa60>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:39.242518 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-be5f8042-52f0-4930-af06-114b421c87a9 tempest-TestShelveInstance-384588627 tempest-TestShelveInstance-384588627-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1132735024" status: 202 len: 0 microversion: 2.1 time: 0.025783 Dec 16 15:56:39.243227 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 492/1051] 10.222.0.31 () {58 vars in 1253 bytes} [Thu Dec 16 15:56:39 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1132735024 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:56:39.779366 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-af6326ec-deca-496d-9c58-c4b36877156b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:39.780576 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-af6326ec-deca-496d-9c58-c4b36877156b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:39.787018 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-af6326ec-deca-496d-9c58-c4b36877156b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:39.787805 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-af6326ec-deca-496d-9c58-c4b36877156b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:39.788809 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-af6326ec-deca-496d-9c58-c4b36877156b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:39.789529 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-af6326ec-deca-496d-9c58-c4b36877156b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:39.954292 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-af6326ec-deca-496d-9c58-c4b36877156b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:39.963647 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-af6326ec-deca-496d-9c58-c4b36877156b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:39.965145 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-af6326ec-deca-496d-9c58-c4b36877156b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:39.966351 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-af6326ec-deca-496d-9c58-c4b36877156b tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1741 microversion: 2.20 time: 0.190845 Dec 16 15:56:39.966941 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 560/1052] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:56:39 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1741 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:56:40.985037 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-d4d1b463-c280-4377-b0c8-a6cb58743ccb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:40.986586 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-d4d1b463-c280-4377-b0c8-a6cb58743ccb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:40.992631 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d4d1b463-c280-4377-b0c8-a6cb58743ccb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:40.993623 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d4d1b463-c280-4377-b0c8-a6cb58743ccb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:40.994643 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d4d1b463-c280-4377-b0c8-a6cb58743ccb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:40.995286 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d4d1b463-c280-4377-b0c8-a6cb58743ccb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:41.175683 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-d4d1b463-c280-4377-b0c8-a6cb58743ccb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:41.185321 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-d4d1b463-c280-4377-b0c8-a6cb58743ccb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:41.187559 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-d4d1b463-c280-4377-b0c8-a6cb58743ccb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:41.188977 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-d4d1b463-c280-4377-b0c8-a6cb58743ccb tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1741 microversion: 2.20 time: 0.207882 Dec 16 15:56:41.190101 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 493/1053] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:56:40 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1741 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:56:42.208092 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-845a659c-3ceb-4351-88c2-ddb99a217666 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:42.208754 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-845a659c-3ceb-4351-88c2-ddb99a217666 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:42.221778 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-845a659c-3ceb-4351-88c2-ddb99a217666 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:42.222525 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-845a659c-3ceb-4351-88c2-ddb99a217666 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:42.223544 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-845a659c-3ceb-4351-88c2-ddb99a217666 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:42.224166 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-845a659c-3ceb-4351-88c2-ddb99a217666 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:42.493729 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-845a659c-3ceb-4351-88c2-ddb99a217666 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:42.501954 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-845a659c-3ceb-4351-88c2-ddb99a217666 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:42.507391 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-845a659c-3ceb-4351-88c2-ddb99a217666 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:42.511186 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-845a659c-3ceb-4351-88c2-ddb99a217666 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1741 microversion: 2.20 time: 0.307528 Dec 16 15:56:42.513764 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 561/1054] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:56:42 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1741 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:56:43.529325 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-de75e758-c971-489e-a36b-4d3294962426 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:43.530680 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-de75e758-c971-489e-a36b-4d3294962426 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:43.537588 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-de75e758-c971-489e-a36b-4d3294962426 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:43.539763 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-de75e758-c971-489e-a36b-4d3294962426 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:43.541337 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-de75e758-c971-489e-a36b-4d3294962426 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:43.542892 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-de75e758-c971-489e-a36b-4d3294962426 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:43.783034 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-de75e758-c971-489e-a36b-4d3294962426 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:43.792557 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-de75e758-c971-489e-a36b-4d3294962426 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:43.795430 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-de75e758-c971-489e-a36b-4d3294962426 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:43.798749 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-de75e758-c971-489e-a36b-4d3294962426 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1741 microversion: 2.20 time: 0.273075 Dec 16 15:56:43.813116 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 494/1055] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:56:43 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1741 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:56:44.820853 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-c091dada-aa09-4553-97fe-72387893dd43 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:44.821490 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-c091dada-aa09-4553-97fe-72387893dd43 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:44.828472 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c091dada-aa09-4553-97fe-72387893dd43 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:44.829166 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c091dada-aa09-4553-97fe-72387893dd43 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:44.830566 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c091dada-aa09-4553-97fe-72387893dd43 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:44.836143 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c091dada-aa09-4553-97fe-72387893dd43 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:45.111327 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-c091dada-aa09-4553-97fe-72387893dd43 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:45.124340 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-c091dada-aa09-4553-97fe-72387893dd43 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:45.126189 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-c091dada-aa09-4553-97fe-72387893dd43 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:45.127606 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-c091dada-aa09-4553-97fe-72387893dd43 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1741 microversion: 2.20 time: 0.311369 Dec 16 15:56:45.128472 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 562/1056] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:56:44 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1741 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:56:46.146903 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-2d9b3ea0-1f00-4bcc-ac21-4b339f1c9f94 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:46.147456 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-2d9b3ea0-1f00-4bcc-ac21-4b339f1c9f94 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:46.154237 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2d9b3ea0-1f00-4bcc-ac21-4b339f1c9f94 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:46.154692 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2d9b3ea0-1f00-4bcc-ac21-4b339f1c9f94 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:46.155475 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2d9b3ea0-1f00-4bcc-ac21-4b339f1c9f94 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:46.155906 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2d9b3ea0-1f00-4bcc-ac21-4b339f1c9f94 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:46.462869 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-2d9b3ea0-1f00-4bcc-ac21-4b339f1c9f94 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:46.469034 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-2d9b3ea0-1f00-4bcc-ac21-4b339f1c9f94 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:46.470653 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-2d9b3ea0-1f00-4bcc-ac21-4b339f1c9f94 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:46.473092 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-2d9b3ea0-1f00-4bcc-ac21-4b339f1c9f94 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1741 microversion: 2.20 time: 0.330047 Dec 16 15:56:46.474011 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 495/1057] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:56:46 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1741 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:56:47.492565 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-eff48f83-f805-434a-9307-0556bc74e395 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:47.493206 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-eff48f83-f805-434a-9307-0556bc74e395 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:47.500267 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-eff48f83-f805-434a-9307-0556bc74e395 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:47.500882 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-eff48f83-f805-434a-9307-0556bc74e395 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:47.501925 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-eff48f83-f805-434a-9307-0556bc74e395 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:47.502479 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-eff48f83-f805-434a-9307-0556bc74e395 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:47.644603 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-eff48f83-f805-434a-9307-0556bc74e395 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:47.652560 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-eff48f83-f805-434a-9307-0556bc74e395 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:47.654098 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-eff48f83-f805-434a-9307-0556bc74e395 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:47.655277 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-eff48f83-f805-434a-9307-0556bc74e395 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1723 microversion: 2.20 time: 0.166756 Dec 16 15:56:47.655835 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 563/1058] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:56:47 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:56:48.674138 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-489d7e7d-f801-4a28-90b6-2319e6879fe4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:48.674816 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-489d7e7d-f801-4a28-90b6-2319e6879fe4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:48.682714 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-489d7e7d-f801-4a28-90b6-2319e6879fe4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:48.683523 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-489d7e7d-f801-4a28-90b6-2319e6879fe4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:48.684326 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-489d7e7d-f801-4a28-90b6-2319e6879fe4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:48.684904 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-489d7e7d-f801-4a28-90b6-2319e6879fe4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:48.824993 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-489d7e7d-f801-4a28-90b6-2319e6879fe4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:48.833346 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-489d7e7d-f801-4a28-90b6-2319e6879fe4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:48.834759 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-489d7e7d-f801-4a28-90b6-2319e6879fe4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:48.835982 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-489d7e7d-f801-4a28-90b6-2319e6879fe4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1723 microversion: 2.20 time: 0.166330 Dec 16 15:56:48.836585 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 496/1059] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:56:48 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:56:49.858592 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-0fafd76a-f9d4-4d15-9a9a-5234c3797743 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:49.859517 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-0fafd76a-f9d4-4d15-9a9a-5234c3797743 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:49.870465 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0fafd76a-f9d4-4d15-9a9a-5234c3797743 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:49.871211 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0fafd76a-f9d4-4d15-9a9a-5234c3797743 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:49.872483 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0fafd76a-f9d4-4d15-9a9a-5234c3797743 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:49.873206 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-0fafd76a-f9d4-4d15-9a9a-5234c3797743 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:50.008297 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-0fafd76a-f9d4-4d15-9a9a-5234c3797743 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:50.016555 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-0fafd76a-f9d4-4d15-9a9a-5234c3797743 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:50.018076 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-0fafd76a-f9d4-4d15-9a9a-5234c3797743 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:50.019232 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-0fafd76a-f9d4-4d15-9a9a-5234c3797743 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1666 microversion: 2.20 time: 0.166824 Dec 16 15:56:50.019799 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 564/1060] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:56:49 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1666 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:56:50.036676 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-da63b7e4-ca08-45c5-93a7-f614025b81b4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4e16889-6fb8-49b8-bec8-05424fc54712"}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:56:50.037770 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-da63b7e4-ca08-45c5-93a7-f614025b81b4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:50.044634 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-da63b7e4-ca08-45c5-93a7-f614025b81b4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:50.045083 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-da63b7e4-ca08-45c5-93a7-f614025b81b4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:50.045928 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-da63b7e4-ca08-45c5-93a7-f614025b81b4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:50.046355 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-da63b7e4-ca08-45c5-93a7-f614025b81b4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:50.328134 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-da63b7e4-ca08-45c5-93a7-f614025b81b4 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.295271 Dec 16 15:56:50.328742 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 497/1061] 10.222.0.31 () {62 vars in 1363 bytes} [Thu Dec 16 15:56:50 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/os-volume_attachments => generated 188 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:56:50.440570 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-90dd12fb-67dc-4d09-9a62-3cbcc16d2c19 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:50.441068 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-90dd12fb-67dc-4d09-9a62-3cbcc16d2c19 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:50.447160 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-90dd12fb-67dc-4d09-9a62-3cbcc16d2c19 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:50.447617 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-90dd12fb-67dc-4d09-9a62-3cbcc16d2c19 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:50.448390 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-90dd12fb-67dc-4d09-9a62-3cbcc16d2c19 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:50.448827 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-90dd12fb-67dc-4d09-9a62-3cbcc16d2c19 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:50.680720 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-90dd12fb-67dc-4d09-9a62-3cbcc16d2c19 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "DELETE /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/os-volume_attachments/f4e16889-6fb8-49b8-bec8-05424fc54712" status: 202 len: 0 microversion: 2.20 time: 0.243997 Dec 16 15:56:50.681485 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 565/1062] 10.222.0.31 () {60 vars in 1456 bytes} [Thu Dec 16 15:56:50 2021] DELETE /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/os-volume_attachments/f4e16889-6fb8-49b8-bec8-05424fc54712 => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:56:50.735006 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-a98d2192-f85f-42c7-a6f2-9fc54aab01c9 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:56:50.735563 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-a98d2192-f85f-42c7-a6f2-9fc54aab01c9 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:50.742125 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a98d2192-f85f-42c7-a6f2-9fc54aab01c9 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:50.742562 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a98d2192-f85f-42c7-a6f2-9fc54aab01c9 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:50.743332 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a98d2192-f85f-42c7-a6f2-9fc54aab01c9 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:50.743757 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a98d2192-f85f-42c7-a6f2-9fc54aab01c9 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:50.825110 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-a98d2192-f85f-42c7-a6f2-9fc54aab01c9 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action" status: 202 len: 0 microversion: 2.20 time: 0.093816 Dec 16 15:56:50.825833 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 498/1063] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Dec 16 15:56:50 2021] POST /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:56:50.833867 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-379a17a6-00fc-4bae-8b69-ada962c22d1a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:50.834471 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-379a17a6-00fc-4bae-8b69-ada962c22d1a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:50.840348 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-379a17a6-00fc-4bae-8b69-ada962c22d1a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:50.840791 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-379a17a6-00fc-4bae-8b69-ada962c22d1a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:50.841592 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-379a17a6-00fc-4bae-8b69-ada962c22d1a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:50.842372 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-379a17a6-00fc-4bae-8b69-ada962c22d1a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:50.977222 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-379a17a6-00fc-4bae-8b69-ada962c22d1a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:50.985180 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-379a17a6-00fc-4bae-8b69-ada962c22d1a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:50.986711 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-379a17a6-00fc-4bae-8b69-ada962c22d1a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:50.987892 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-379a17a6-00fc-4bae-8b69-ada962c22d1a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1674 microversion: 2.20 time: 0.157816 Dec 16 15:56:50.988459 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 566/1064] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:56:50 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:56:51.202508 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-aa887b7d-d672-4b6e-afde-ba8896580991 req-704de1aa-1e49-465e-ac82-6a70ce58a7d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53cb08f0-26a5-4811-9df7-b5a346757838", "name": "network-vif-unplugged", "status": "completed", "tag": "18769a46-6816-4b5e-bcc0-d0d8cac455d6"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:56:51.204163 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:56:51.204163 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:56:51.212296 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-aa887b7d-d672-4b6e-afde-ba8896580991 req-704de1aa-1e49-465e-ac82-6a70ce58a7d7 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:51.212844 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-aa887b7d-d672-4b6e-afde-ba8896580991 req-704de1aa-1e49-465e-ac82-6a70ce58a7d7 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:51.227048 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.compute.server_external_events [req-aa887b7d-d672-4b6e-afde-ba8896580991 req-704de1aa-1e49-465e-ac82-6a70ce58a7d7 service nova] Unable to find a host for instance 53cb08f0-26a5-4811-9df7-b5a346757838. Dropping event network-vif-unplugged {{(pid=122398) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 16 15:56:51.227920 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-aa887b7d-d672-4b6e-afde-ba8896580991 req-704de1aa-1e49-465e-ac82-6a70ce58a7d7 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031645 Dec 16 15:56:51.228481 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 499/1065] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:56:51 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 16 15:56:52.009651 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-cebea2e3-761c-460c-bbf5-d11aa9f9db83 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:52.010223 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-cebea2e3-761c-460c-bbf5-d11aa9f9db83 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:52.016439 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-cebea2e3-761c-460c-bbf5-d11aa9f9db83 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:52.016894 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-cebea2e3-761c-460c-bbf5-d11aa9f9db83 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:52.017719 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-cebea2e3-761c-460c-bbf5-d11aa9f9db83 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:52.018153 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-cebea2e3-761c-460c-bbf5-d11aa9f9db83 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:52.153947 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-cebea2e3-761c-460c-bbf5-d11aa9f9db83 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:52.162105 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-cebea2e3-761c-460c-bbf5-d11aa9f9db83 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:52.163584 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-cebea2e3-761c-460c-bbf5-d11aa9f9db83 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:52.164776 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-cebea2e3-761c-460c-bbf5-d11aa9f9db83 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1732 microversion: 2.20 time: 0.160904 Dec 16 15:56:52.165338 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 567/1066] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:56:52 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:56:53.187001 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-db274568-7e4d-4ab7-b908-f9eef13880be tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:53.188555 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-db274568-7e4d-4ab7-b908-f9eef13880be tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:53.205809 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-db274568-7e4d-4ab7-b908-f9eef13880be tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:53.206954 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-db274568-7e4d-4ab7-b908-f9eef13880be tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:53.208150 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-db274568-7e4d-4ab7-b908-f9eef13880be tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:53.208857 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-db274568-7e4d-4ab7-b908-f9eef13880be tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:53.389099 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-db274568-7e4d-4ab7-b908-f9eef13880be tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:53.397672 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-db274568-7e4d-4ab7-b908-f9eef13880be tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:53.399317 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-db274568-7e4d-4ab7-b908-f9eef13880be tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:53.400576 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-db274568-7e4d-4ab7-b908-f9eef13880be tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1732 microversion: 2.20 time: 0.219394 Dec 16 15:56:53.401248 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 500/1067] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:56:53 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1732 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:56:54.419056 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-8830fc4d-379b-4c41-aa61-1bd9db0aa6b0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:54.420339 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-8830fc4d-379b-4c41-aa61-1bd9db0aa6b0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:54.427494 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8830fc4d-379b-4c41-aa61-1bd9db0aa6b0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:54.428213 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8830fc4d-379b-4c41-aa61-1bd9db0aa6b0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:54.429666 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8830fc4d-379b-4c41-aa61-1bd9db0aa6b0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:54.430267 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8830fc4d-379b-4c41-aa61-1bd9db0aa6b0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:54.574960 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-8830fc4d-379b-4c41-aa61-1bd9db0aa6b0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:54.584437 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-8830fc4d-379b-4c41-aa61-1bd9db0aa6b0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:54.586791 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-8830fc4d-379b-4c41-aa61-1bd9db0aa6b0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:54.588435 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-8830fc4d-379b-4c41-aa61-1bd9db0aa6b0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1732 microversion: 2.20 time: 0.173550 Dec 16 15:56:54.589730 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 568/1068] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:56:54 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:56:55.606946 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-2ce9605b-4ff3-4e86-8eb0-a904a5ca94b2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:55.607563 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-2ce9605b-4ff3-4e86-8eb0-a904a5ca94b2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:55.614188 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2ce9605b-4ff3-4e86-8eb0-a904a5ca94b2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:55.614638 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2ce9605b-4ff3-4e86-8eb0-a904a5ca94b2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:55.615429 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2ce9605b-4ff3-4e86-8eb0-a904a5ca94b2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:55.615872 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2ce9605b-4ff3-4e86-8eb0-a904a5ca94b2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:55.749897 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-2ce9605b-4ff3-4e86-8eb0-a904a5ca94b2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:55.758324 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-2ce9605b-4ff3-4e86-8eb0-a904a5ca94b2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:55.759734 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-2ce9605b-4ff3-4e86-8eb0-a904a5ca94b2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:55.760906 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-2ce9605b-4ff3-4e86-8eb0-a904a5ca94b2 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1732 microversion: 2.20 time: 0.157772 Dec 16 15:56:55.761549 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 501/1069] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:56:55 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:56:56.781342 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-16d2a321-313d-4988-a110-e53ec4216e5a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:56.782038 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-16d2a321-313d-4988-a110-e53ec4216e5a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:56.788909 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-16d2a321-313d-4988-a110-e53ec4216e5a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:56.789456 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-16d2a321-313d-4988-a110-e53ec4216e5a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:56.790340 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-16d2a321-313d-4988-a110-e53ec4216e5a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:56.790773 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-16d2a321-313d-4988-a110-e53ec4216e5a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:56.932322 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-16d2a321-313d-4988-a110-e53ec4216e5a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:56.940323 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-16d2a321-313d-4988-a110-e53ec4216e5a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:56.941842 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-16d2a321-313d-4988-a110-e53ec4216e5a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:56.943000 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-16d2a321-313d-4988-a110-e53ec4216e5a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1732 microversion: 2.20 time: 0.166826 Dec 16 15:56:56.943551 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 569/1070] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:56:56 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:56:57.965309 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-c0304298-7d1d-425b-8521-4118ef117d7d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:57.966099 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-c0304298-7d1d-425b-8521-4118ef117d7d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:57.975612 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c0304298-7d1d-425b-8521-4118ef117d7d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:57.976081 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c0304298-7d1d-425b-8521-4118ef117d7d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:57.976861 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c0304298-7d1d-425b-8521-4118ef117d7d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:57.977294 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c0304298-7d1d-425b-8521-4118ef117d7d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:58.115815 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-c0304298-7d1d-425b-8521-4118ef117d7d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:58.123646 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-c0304298-7d1d-425b-8521-4118ef117d7d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:58.125126 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-c0304298-7d1d-425b-8521-4118ef117d7d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:58.126299 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-c0304298-7d1d-425b-8521-4118ef117d7d tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1732 microversion: 2.20 time: 0.166924 Dec 16 15:56:58.126864 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 502/1071] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:56:57 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:56:59.144542 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-661d980c-e783-433a-bcba-cbdd31df3602 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:56:59.145125 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-661d980c-e783-433a-bcba-cbdd31df3602 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:56:59.151773 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-661d980c-e783-433a-bcba-cbdd31df3602 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:59.152228 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-661d980c-e783-433a-bcba-cbdd31df3602 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:59.153092 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-661d980c-e783-433a-bcba-cbdd31df3602 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:56:59.153627 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-661d980c-e783-433a-bcba-cbdd31df3602 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:56:59.286030 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-661d980c-e783-433a-bcba-cbdd31df3602 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:59.294514 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-661d980c-e783-433a-bcba-cbdd31df3602 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:59.301265 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-661d980c-e783-433a-bcba-cbdd31df3602 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:56:59.302536 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-661d980c-e783-433a-bcba-cbdd31df3602 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1732 microversion: 2.20 time: 0.161879 Dec 16 15:56:59.303103 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 570/1072] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:56:59 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:57:00.320695 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-00427c14-ea03-4132-91e5-a3ba859e7f6f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:00.321395 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-00427c14-ea03-4132-91e5-a3ba859e7f6f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:00.328007 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-00427c14-ea03-4132-91e5-a3ba859e7f6f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:00.328564 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-00427c14-ea03-4132-91e5-a3ba859e7f6f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:00.329442 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-00427c14-ea03-4132-91e5-a3ba859e7f6f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:00.329973 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-00427c14-ea03-4132-91e5-a3ba859e7f6f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:00.476296 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-00427c14-ea03-4132-91e5-a3ba859e7f6f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:00.484200 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-00427c14-ea03-4132-91e5-a3ba859e7f6f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:00.485714 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-00427c14-ea03-4132-91e5-a3ba859e7f6f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:00.486878 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-00427c14-ea03-4132-91e5-a3ba859e7f6f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1732 microversion: 2.20 time: 0.169967 Dec 16 15:57:00.487433 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 503/1073] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:57:00 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:57:01.508479 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-7d8722f4-e6c2-47c7-97bd-87714d14aa91 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:01.509844 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-7d8722f4-e6c2-47c7-97bd-87714d14aa91 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:01.517368 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7d8722f4-e6c2-47c7-97bd-87714d14aa91 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:01.517852 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7d8722f4-e6c2-47c7-97bd-87714d14aa91 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:01.518647 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7d8722f4-e6c2-47c7-97bd-87714d14aa91 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:01.519091 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7d8722f4-e6c2-47c7-97bd-87714d14aa91 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:01.657869 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-7d8722f4-e6c2-47c7-97bd-87714d14aa91 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:01.668122 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-7d8722f4-e6c2-47c7-97bd-87714d14aa91 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:01.670092 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-7d8722f4-e6c2-47c7-97bd-87714d14aa91 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:01.671460 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-7d8722f4-e6c2-47c7-97bd-87714d14aa91 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1732 microversion: 2.20 time: 0.170883 Dec 16 15:57:01.673027 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 571/1074] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:57:01 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:57:02.690839 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-a3953792-6207-42ca-bd4d-88b44fbdf1c5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:02.691515 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-a3953792-6207-42ca-bd4d-88b44fbdf1c5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:02.698631 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a3953792-6207-42ca-bd4d-88b44fbdf1c5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:02.699161 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a3953792-6207-42ca-bd4d-88b44fbdf1c5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:02.699997 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a3953792-6207-42ca-bd4d-88b44fbdf1c5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:02.700434 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-a3953792-6207-42ca-bd4d-88b44fbdf1c5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:02.838179 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-a3953792-6207-42ca-bd4d-88b44fbdf1c5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:02.846324 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-a3953792-6207-42ca-bd4d-88b44fbdf1c5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:02.847805 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-a3953792-6207-42ca-bd4d-88b44fbdf1c5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:02.848946 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-a3953792-6207-42ca-bd4d-88b44fbdf1c5 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1732 microversion: 2.20 time: 0.162141 Dec 16 15:57:02.849557 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 504/1075] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:57:02 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:57:03.868181 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ede0c540-89f2-4e26-9b88-40db7eca996a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:03.868772 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-ede0c540-89f2-4e26-9b88-40db7eca996a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:03.875373 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ede0c540-89f2-4e26-9b88-40db7eca996a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:03.875826 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ede0c540-89f2-4e26-9b88-40db7eca996a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:03.876603 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ede0c540-89f2-4e26-9b88-40db7eca996a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:03.877038 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ede0c540-89f2-4e26-9b88-40db7eca996a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:04.013926 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-ede0c540-89f2-4e26-9b88-40db7eca996a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:04.022316 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-ede0c540-89f2-4e26-9b88-40db7eca996a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:04.023799 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-ede0c540-89f2-4e26-9b88-40db7eca996a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:04.024984 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-ede0c540-89f2-4e26-9b88-40db7eca996a tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1732 microversion: 2.20 time: 0.160619 Dec 16 15:57:04.025551 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 572/1076] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:57:03 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:57:05.049786 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-dcb03d16-d0f1-4576-a705-f94e3ae874c0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:05.050777 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-dcb03d16-d0f1-4576-a705-f94e3ae874c0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:05.060646 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-dcb03d16-d0f1-4576-a705-f94e3ae874c0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:05.061116 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-dcb03d16-d0f1-4576-a705-f94e3ae874c0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:05.062002 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-dcb03d16-d0f1-4576-a705-f94e3ae874c0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:05.062414 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-dcb03d16-d0f1-4576-a705-f94e3ae874c0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:05.210157 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-dcb03d16-d0f1-4576-a705-f94e3ae874c0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:05.218812 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-dcb03d16-d0f1-4576-a705-f94e3ae874c0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:05.220454 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-dcb03d16-d0f1-4576-a705-f94e3ae874c0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:05.221843 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-dcb03d16-d0f1-4576-a705-f94e3ae874c0 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1732 microversion: 2.20 time: 0.180878 Dec 16 15:57:05.222598 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 505/1077] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:57:05 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1732 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:57:06.244049 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-f838f676-d4ae-4315-9838-096c681e28f6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:06.245055 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-f838f676-d4ae-4315-9838-096c681e28f6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:06.255727 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f838f676-d4ae-4315-9838-096c681e28f6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:06.256477 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f838f676-d4ae-4315-9838-096c681e28f6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:06.257839 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f838f676-d4ae-4315-9838-096c681e28f6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:06.258567 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f838f676-d4ae-4315-9838-096c681e28f6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:06.395202 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-f838f676-d4ae-4315-9838-096c681e28f6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:06.403514 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-f838f676-d4ae-4315-9838-096c681e28f6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:06.404975 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-f838f676-d4ae-4315-9838-096c681e28f6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:06.406434 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-f838f676-d4ae-4315-9838-096c681e28f6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1732 microversion: 2.20 time: 0.168611 Dec 16 15:57:06.406799 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 573/1078] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:57:06 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:57:07.424506 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-d2c9bd28-0419-4314-bdd9-ad8e56fa5905 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:07.425125 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-d2c9bd28-0419-4314-bdd9-ad8e56fa5905 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:07.432720 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d2c9bd28-0419-4314-bdd9-ad8e56fa5905 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:07.433186 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d2c9bd28-0419-4314-bdd9-ad8e56fa5905 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:07.434062 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d2c9bd28-0419-4314-bdd9-ad8e56fa5905 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:07.434497 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d2c9bd28-0419-4314-bdd9-ad8e56fa5905 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:07.460452 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-9055010f-3805-4ccf-9cd1-b77c7c66d93d req-c97722e1-a974-4d06-a507-b6248ced5c0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53cb08f0-26a5-4811-9df7-b5a346757838", "name": "network-vif-plugged", "status": "completed", "tag": "18769a46-6816-4b5e-bcc0-d0d8cac455d6"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:57:07.462072 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:57:07.462072 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:57:07.469790 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-9055010f-3805-4ccf-9cd1-b77c7c66d93d req-c97722e1-a974-4d06-a507-b6248ced5c0b service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:07.470713 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-9055010f-3805-4ccf-9cd1-b77c7c66d93d req-c97722e1-a974-4d06-a507-b6248ced5c0b service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:07.491636 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-9055010f-3805-4ccf-9cd1-b77c7c66d93d req-c97722e1-a974-4d06-a507-b6248ced5c0b service nova] Creating event network-vif-plugged:18769a46-6816-4b5e-bcc0-d0d8cac455d6 for instance 53cb08f0-26a5-4811-9df7-b5a346757838 on hv-cinder-78447 Dec 16 15:57:07.503331 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-9055010f-3805-4ccf-9cd1-b77c7c66d93d req-c97722e1-a974-4d06-a507-b6248ced5c0b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045691 Dec 16 15:57:07.504492 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 574/1079] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:57:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:57:07.580382 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-d2c9bd28-0419-4314-bdd9-ad8e56fa5905 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:07.588254 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-d2c9bd28-0419-4314-bdd9-ad8e56fa5905 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:07.589769 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-d2c9bd28-0419-4314-bdd9-ad8e56fa5905 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:07.590917 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-d2c9bd28-0419-4314-bdd9-ad8e56fa5905 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1732 microversion: 2.20 time: 0.170575 Dec 16 15:57:07.591795 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 506/1080] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:57:07 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:57:08.614919 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-433f47e9-032d-4572-b4a6-c23f3cce80f6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:08.616024 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-433f47e9-032d-4572-b4a6-c23f3cce80f6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:08.626565 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-433f47e9-032d-4572-b4a6-c23f3cce80f6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:08.627153 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-433f47e9-032d-4572-b4a6-c23f3cce80f6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:08.627934 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-433f47e9-032d-4572-b4a6-c23f3cce80f6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:08.628363 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-433f47e9-032d-4572-b4a6-c23f3cce80f6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:08.772540 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-433f47e9-032d-4572-b4a6-c23f3cce80f6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:08.780877 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-433f47e9-032d-4572-b4a6-c23f3cce80f6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:08.782545 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-433f47e9-032d-4572-b4a6-c23f3cce80f6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:08.783860 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-433f47e9-032d-4572-b4a6-c23f3cce80f6 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1732 microversion: 2.20 time: 0.176715 Dec 16 15:57:08.784421 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 575/1081] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:57:08 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:57:09.803472 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-b3abef82-84c5-4d37-8c1b-dc7044bb6b74 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:09.804091 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-b3abef82-84c5-4d37-8c1b-dc7044bb6b74 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:09.810882 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b3abef82-84c5-4d37-8c1b-dc7044bb6b74 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:09.811339 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b3abef82-84c5-4d37-8c1b-dc7044bb6b74 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:09.812118 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b3abef82-84c5-4d37-8c1b-dc7044bb6b74 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:09.812552 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b3abef82-84c5-4d37-8c1b-dc7044bb6b74 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:09.958637 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-b3abef82-84c5-4d37-8c1b-dc7044bb6b74 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:09.966723 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-b3abef82-84c5-4d37-8c1b-dc7044bb6b74 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:09.968217 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-b3abef82-84c5-4d37-8c1b-dc7044bb6b74 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:09.969359 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-b3abef82-84c5-4d37-8c1b-dc7044bb6b74 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1719 microversion: 2.20 time: 0.169703 Dec 16 15:57:09.969958 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 507/1082] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:57:09 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1719 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:57:25.240807 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-5dd56a63-5a34-40ba-8e8f-2e8c51c0cb8d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2107941602", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-824262971", "security_groups": [{"name": "tempest-secgroup-smoke-832002217"}], "block_device_mapping_v2": [{"uuid": "5cca790c-da36-426a-bd55-37d93b270680", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "447cd8ca-a758-4b0d-966f-d4641376c8a8"}]}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:57:25.359875 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.network.neutron [None req-5dd56a63-5a34-40ba-8e8f-2e8c51c0cb8d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] validate_networks() for [('447cd8ca-a758-4b0d-966f-d4641376c8a8', None, None, None, None, None)] {{(pid=122399) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 15:57:26.007195 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-5dd56a63-5a34-40ba-8e8f-2e8c51c0cb8d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Flavor limits 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 15:57:26.007614 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-5dd56a63-5a34-40ba-8e8f-2e8c51c0cb8d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Image limits 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 15:57:26.008086 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-5dd56a63-5a34-40ba-8e8f-2e8c51c0cb8d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Flavor pref 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 15:57:26.008485 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-5dd56a63-5a34-40ba-8e8f-2e8c51c0cb8d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Image pref 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 15:57:26.008890 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-5dd56a63-5a34-40ba-8e8f-2e8c51c0cb8d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 15:57:26.021029 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5dd56a63-5a34-40ba-8e8f-2e8c51c0cb8d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:26.021507 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5dd56a63-5a34-40ba-8e8f-2e8c51c0cb8d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:26.022323 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5dd56a63-5a34-40ba-8e8f-2e8c51c0cb8d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:26.022775 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5dd56a63-5a34-40ba-8e8f-2e8c51c0cb8d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:26.040414 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-5dd56a63-5a34-40ba-8e8f-2e8c51c0cb8d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Getting quotas for project 5afea3407ef84fafa658a82512fb4d24. Resources: {'instances', 'ram', 'cores'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:57:26.044844 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-5dd56a63-5a34-40ba-8e8f-2e8c51c0cb8d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Getting quotas for user 92fd364ddd594b9eb5fe5ffad72ac32e and project 5afea3407ef84fafa658a82512fb4d24. Resources: {'instances', 'ram', 'cores'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:57:26.100708 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-5dd56a63-5a34-40ba-8e8f-2e8c51c0cb8d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Going to run 1 instances... {{(pid=122399) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 15:57:26.102869 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-5dd56a63-5a34-40ba-8e8f-2e8c51c0cb8d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b8c9604f-bac4-43ac-865e-75e3a2edd325] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5cca790c-da36-426a-bd55-37d93b270680',volume_size=None,volume_type=None)] {{(pid=122399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 15:57:26.237319 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-5dd56a63-5a34-40ba-8e8f-2e8c51c0cb8d tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.000257 Dec 16 15:57:26.237997 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 576/1083] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Dec 16 15:57:25 2021] POST /compute/v2.1/servers => generated 405 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 15:57:26.248081 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-57aee18f-8eb7-4f48-9773-2bd509403537 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:26.248677 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-57aee18f-8eb7-4f48-9773-2bd509403537 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b8c9604f-bac4-43ac-865e-75e3a2edd325] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:26.305537 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-57aee18f-8eb7-4f48-9773-2bd509403537 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:26.313303 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-57aee18f-8eb7-4f48-9773-2bd509403537 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325" status: 200 len: 1094 microversion: 2.1 time: 0.068856 Dec 16 15:57:26.314077 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 508/1084] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:57:26 2021] GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:57:27.331623 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-3c7c832f-c36e-4eb7-b95f-bca6ee8494ca tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:27.333454 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-3c7c832f-c36e-4eb7-b95f-bca6ee8494ca tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b8c9604f-bac4-43ac-865e-75e3a2edd325] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:27.339343 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3c7c832f-c36e-4eb7-b95f-bca6ee8494ca tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:27.339807 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3c7c832f-c36e-4eb7-b95f-bca6ee8494ca tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:27.340635 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3c7c832f-c36e-4eb7-b95f-bca6ee8494ca tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:27.341390 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-3c7c832f-c36e-4eb7-b95f-bca6ee8494ca tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:27.402250 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-3c7c832f-c36e-4eb7-b95f-bca6ee8494ca tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:27.410077 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-3c7c832f-c36e-4eb7-b95f-bca6ee8494ca tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325" status: 200 len: 1210 microversion: 2.1 time: 0.083199 Dec 16 15:57:27.410624 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 577/1085] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:57:27 2021] GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325 => generated 1210 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:57:28.427378 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-fc34dcc2-7c32-4f2a-9e6c-a8ad99f30618 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:28.428003 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-fc34dcc2-7c32-4f2a-9e6c-a8ad99f30618 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b8c9604f-bac4-43ac-865e-75e3a2edd325] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:28.434721 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-fc34dcc2-7c32-4f2a-9e6c-a8ad99f30618 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:28.435267 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-fc34dcc2-7c32-4f2a-9e6c-a8ad99f30618 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:28.436109 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-fc34dcc2-7c32-4f2a-9e6c-a8ad99f30618 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:28.436576 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-fc34dcc2-7c32-4f2a-9e6c-a8ad99f30618 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:28.576978 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-fc34dcc2-7c32-4f2a-9e6c-a8ad99f30618 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:28.585643 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-fc34dcc2-7c32-4f2a-9e6c-a8ad99f30618 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325" status: 200 len: 1265 microversion: 2.1 time: 0.161693 Dec 16 15:57:28.586836 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 509/1086] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:57:28 2021] GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:57:28.768321 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-3b362541-64f3-4a3b-b535-095310cb2e71 req-8cd6202b-0db4-4a22-a0de-bb51bfd16509 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8c9604f-bac4-43ac-865e-75e3a2edd325", "tag": "f51fbc3e-acde-4d09-b30a-784b2fecbdae"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:57:28.770341 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:57:28.770341 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:57:28.779120 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-3b362541-64f3-4a3b-b535-095310cb2e71 req-8cd6202b-0db4-4a22-a0de-bb51bfd16509 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:28.779567 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-3b362541-64f3-4a3b-b535-095310cb2e71 req-8cd6202b-0db4-4a22-a0de-bb51bfd16509 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:28.795845 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-3b362541-64f3-4a3b-b535-095310cb2e71 req-8cd6202b-0db4-4a22-a0de-bb51bfd16509 service nova] Creating event network-changed:f51fbc3e-acde-4d09-b30a-784b2fecbdae for instance b8c9604f-bac4-43ac-865e-75e3a2edd325 on hv-cinder-78447 Dec 16 15:57:28.802795 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-3b362541-64f3-4a3b-b535-095310cb2e71 req-8cd6202b-0db4-4a22-a0de-bb51bfd16509 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038419 Dec 16 15:57:28.803325 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 578/1087] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:57:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:57:29.602955 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-ff490939-a87a-407e-b1d9-43068b775c47 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:29.603537 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-ff490939-a87a-407e-b1d9-43068b775c47 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b8c9604f-bac4-43ac-865e-75e3a2edd325] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:29.610018 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ff490939-a87a-407e-b1d9-43068b775c47 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:29.610500 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ff490939-a87a-407e-b1d9-43068b775c47 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:29.611264 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ff490939-a87a-407e-b1d9-43068b775c47 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:29.611801 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ff490939-a87a-407e-b1d9-43068b775c47 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:29.753615 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-ff490939-a87a-407e-b1d9-43068b775c47 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:29.761003 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-ff490939-a87a-407e-b1d9-43068b775c47 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325" status: 200 len: 1265 microversion: 2.1 time: 0.161748 Dec 16 15:57:29.761594 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 510/1088] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:57:29 2021] GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:57:30.783069 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-c53b2079-912a-41f2-aca9-62eabb2c62cd tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:30.783775 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-c53b2079-912a-41f2-aca9-62eabb2c62cd tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b8c9604f-bac4-43ac-865e-75e3a2edd325] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:30.790418 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c53b2079-912a-41f2-aca9-62eabb2c62cd tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:30.790869 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c53b2079-912a-41f2-aca9-62eabb2c62cd tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:30.791673 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c53b2079-912a-41f2-aca9-62eabb2c62cd tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:30.792112 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c53b2079-912a-41f2-aca9-62eabb2c62cd tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:30.924413 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-c53b2079-912a-41f2-aca9-62eabb2c62cd tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:30.931766 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-c53b2079-912a-41f2-aca9-62eabb2c62cd tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325" status: 200 len: 1265 microversion: 2.1 time: 0.156063 Dec 16 15:57:30.932328 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 579/1089] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:57:30 2021] GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:57:31.954542 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-bed6c7df-e462-435b-bf61-5a378ea2ad37 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:31.955235 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-bed6c7df-e462-435b-bf61-5a378ea2ad37 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b8c9604f-bac4-43ac-865e-75e3a2edd325] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:31.962945 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-bed6c7df-e462-435b-bf61-5a378ea2ad37 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:31.963462 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-bed6c7df-e462-435b-bf61-5a378ea2ad37 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:31.964362 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-bed6c7df-e462-435b-bf61-5a378ea2ad37 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:31.964860 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-bed6c7df-e462-435b-bf61-5a378ea2ad37 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:32.107424 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-bed6c7df-e462-435b-bf61-5a378ea2ad37 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:32.115249 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-bed6c7df-e462-435b-bf61-5a378ea2ad37 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325" status: 200 len: 1265 microversion: 2.1 time: 0.166965 Dec 16 15:57:32.115821 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 511/1090] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:57:31 2021] GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:57:33.135412 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-b3f85312-3cd6-4da9-8bba-42ea336ea05c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:33.136365 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-b3f85312-3cd6-4da9-8bba-42ea336ea05c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b8c9604f-bac4-43ac-865e-75e3a2edd325] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:33.147059 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b3f85312-3cd6-4da9-8bba-42ea336ea05c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:33.147758 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b3f85312-3cd6-4da9-8bba-42ea336ea05c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:33.149037 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b3f85312-3cd6-4da9-8bba-42ea336ea05c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:33.149802 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b3f85312-3cd6-4da9-8bba-42ea336ea05c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:33.290656 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-b3f85312-3cd6-4da9-8bba-42ea336ea05c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:33.298732 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-b3f85312-3cd6-4da9-8bba-42ea336ea05c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325" status: 200 len: 1265 microversion: 2.1 time: 0.169564 Dec 16 15:57:33.299339 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 580/1091] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:57:33 2021] GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:57:34.318741 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-ef81db4a-d61d-48c7-8ebe-a7b563ec59d1 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:34.319815 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-ef81db4a-d61d-48c7-8ebe-a7b563ec59d1 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b8c9604f-bac4-43ac-865e-75e3a2edd325] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:34.330027 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ef81db4a-d61d-48c7-8ebe-a7b563ec59d1 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:34.330473 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ef81db4a-d61d-48c7-8ebe-a7b563ec59d1 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:34.331254 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ef81db4a-d61d-48c7-8ebe-a7b563ec59d1 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:34.331724 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ef81db4a-d61d-48c7-8ebe-a7b563ec59d1 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:34.466372 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-ef81db4a-d61d-48c7-8ebe-a7b563ec59d1 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:34.476934 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-ef81db4a-d61d-48c7-8ebe-a7b563ec59d1 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325" status: 200 len: 1265 microversion: 2.1 time: 0.164082 Dec 16 15:57:34.477679 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 512/1092] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:57:34 2021] GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:57:35.498113 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-581946a4-5b63-4e25-a8aa-7f9dd0363906 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:35.499111 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-581946a4-5b63-4e25-a8aa-7f9dd0363906 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b8c9604f-bac4-43ac-865e-75e3a2edd325] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:35.506796 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-581946a4-5b63-4e25-a8aa-7f9dd0363906 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:35.507249 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-581946a4-5b63-4e25-a8aa-7f9dd0363906 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:35.508035 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-581946a4-5b63-4e25-a8aa-7f9dd0363906 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:35.508471 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-581946a4-5b63-4e25-a8aa-7f9dd0363906 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:35.649538 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-581946a4-5b63-4e25-a8aa-7f9dd0363906 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:35.657226 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-581946a4-5b63-4e25-a8aa-7f9dd0363906 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325" status: 200 len: 1265 microversion: 2.1 time: 0.165408 Dec 16 15:57:35.657845 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 581/1093] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:57:35 2021] GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:57:36.673983 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-cb5e34dd-cbf0-4849-9605-785d612c8764 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:36.674613 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-cb5e34dd-cbf0-4849-9605-785d612c8764 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b8c9604f-bac4-43ac-865e-75e3a2edd325] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:36.681012 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cb5e34dd-cbf0-4849-9605-785d612c8764 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:36.681480 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cb5e34dd-cbf0-4849-9605-785d612c8764 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:36.682285 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cb5e34dd-cbf0-4849-9605-785d612c8764 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:36.682751 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cb5e34dd-cbf0-4849-9605-785d612c8764 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:36.819309 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-cb5e34dd-cbf0-4849-9605-785d612c8764 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:36.827422 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-cb5e34dd-cbf0-4849-9605-785d612c8764 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325" status: 200 len: 1265 microversion: 2.1 time: 0.157282 Dec 16 15:57:36.827980 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 513/1094] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:57:36 2021] GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:57:37.844589 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-143d1d79-9f2e-46d4-8787-8b6c6adfa19c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:37.845208 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-143d1d79-9f2e-46d4-8787-8b6c6adfa19c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b8c9604f-bac4-43ac-865e-75e3a2edd325] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:37.851966 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-143d1d79-9f2e-46d4-8787-8b6c6adfa19c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:37.852411 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-143d1d79-9f2e-46d4-8787-8b6c6adfa19c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:37.853246 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-143d1d79-9f2e-46d4-8787-8b6c6adfa19c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:37.853704 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-143d1d79-9f2e-46d4-8787-8b6c6adfa19c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:37.985175 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-143d1d79-9f2e-46d4-8787-8b6c6adfa19c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:37.992848 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-143d1d79-9f2e-46d4-8787-8b6c6adfa19c tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325" status: 200 len: 1265 microversion: 2.1 time: 0.152423 Dec 16 15:57:37.993552 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 582/1095] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:57:37 2021] GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:57:39.013762 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-f52b75e1-9312-4634-bcd9-0ce66f21df11 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:39.014750 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-f52b75e1-9312-4634-bcd9-0ce66f21df11 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b8c9604f-bac4-43ac-865e-75e3a2edd325] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:39.025496 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f52b75e1-9312-4634-bcd9-0ce66f21df11 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:39.026340 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f52b75e1-9312-4634-bcd9-0ce66f21df11 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:39.027616 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f52b75e1-9312-4634-bcd9-0ce66f21df11 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:39.028357 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-f52b75e1-9312-4634-bcd9-0ce66f21df11 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:39.165624 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-f52b75e1-9312-4634-bcd9-0ce66f21df11 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:39.173528 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-f52b75e1-9312-4634-bcd9-0ce66f21df11 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325" status: 200 len: 1265 microversion: 2.1 time: 0.166002 Dec 16 15:57:39.174101 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 514/1096] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:57:39 2021] GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:57:39.485781 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-65e029fe-feb9-4dbe-ae48-1bb9b953a62e req-038a384a-3522-4dcb-ae58-d886420f4d67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c9604f-bac4-43ac-865e-75e3a2edd325", "name": "network-vif-plugged", "status": "completed", "tag": "f51fbc3e-acde-4d09-b30a-784b2fecbdae"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:57:39.487389 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:57:39.487389 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:57:39.495118 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-65e029fe-feb9-4dbe-ae48-1bb9b953a62e req-038a384a-3522-4dcb-ae58-d886420f4d67 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:39.495560 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-65e029fe-feb9-4dbe-ae48-1bb9b953a62e req-038a384a-3522-4dcb-ae58-d886420f4d67 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:39.507284 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-65e029fe-feb9-4dbe-ae48-1bb9b953a62e req-038a384a-3522-4dcb-ae58-d886420f4d67 service nova] Creating event network-vif-plugged:f51fbc3e-acde-4d09-b30a-784b2fecbdae for instance b8c9604f-bac4-43ac-865e-75e3a2edd325 on hv-cinder-78447 Dec 16 15:57:39.512405 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-65e029fe-feb9-4dbe-ae48-1bb9b953a62e req-038a384a-3522-4dcb-ae58-d886420f4d67 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034398 Dec 16 15:57:39.513148 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 583/1097] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:57:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:57:40.194176 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-5f6c33f7-8000-4ba3-9cff-975447e9950f tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:40.195304 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-5f6c33f7-8000-4ba3-9cff-975447e9950f tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b8c9604f-bac4-43ac-865e-75e3a2edd325] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:40.205934 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5f6c33f7-8000-4ba3-9cff-975447e9950f tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:40.206703 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5f6c33f7-8000-4ba3-9cff-975447e9950f tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:40.207477 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5f6c33f7-8000-4ba3-9cff-975447e9950f tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:40.207905 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5f6c33f7-8000-4ba3-9cff-975447e9950f tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:40.345264 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-5f6c33f7-8000-4ba3-9cff-975447e9950f tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:40.356242 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-5f6c33f7-8000-4ba3-9cff-975447e9950f tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325" status: 200 len: 1265 microversion: 2.1 time: 0.168096 Dec 16 15:57:40.356859 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 515/1098] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:57:40 2021] GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:57:41.376709 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ef60df72-b2fd-4e29-b57d-94aa2c7afd87 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:41.377674 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-ef60df72-b2fd-4e29-b57d-94aa2c7afd87 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b8c9604f-bac4-43ac-865e-75e3a2edd325] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:41.384651 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ef60df72-b2fd-4e29-b57d-94aa2c7afd87 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:41.385089 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ef60df72-b2fd-4e29-b57d-94aa2c7afd87 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:41.385910 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ef60df72-b2fd-4e29-b57d-94aa2c7afd87 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:41.386355 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ef60df72-b2fd-4e29-b57d-94aa2c7afd87 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:41.527438 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-ef60df72-b2fd-4e29-b57d-94aa2c7afd87 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:41.535019 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-ef60df72-b2fd-4e29-b57d-94aa2c7afd87 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325" status: 200 len: 1451 microversion: 2.1 time: 0.164520 Dec 16 15:57:41.535607 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 584/1099] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:57:41 2021] GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325 => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:57:41.551257 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-c61f3d08-809b-456f-8fc6-9d4cb48baf7f tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:41.551881 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-c61f3d08-809b-456f-8fc6-9d4cb48baf7f tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b8c9604f-bac4-43ac-865e-75e3a2edd325] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:41.558697 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c61f3d08-809b-456f-8fc6-9d4cb48baf7f tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:41.559150 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c61f3d08-809b-456f-8fc6-9d4cb48baf7f tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:41.560028 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c61f3d08-809b-456f-8fc6-9d4cb48baf7f tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:41.560371 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c61f3d08-809b-456f-8fc6-9d4cb48baf7f tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:41.700951 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-c61f3d08-809b-456f-8fc6-9d4cb48baf7f tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:41.708525 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-c61f3d08-809b-456f-8fc6-9d4cb48baf7f tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325" status: 200 len: 1451 microversion: 2.1 time: 0.161079 Dec 16 15:57:41.709093 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 516/1100] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:57:41 2021] GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325 => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:57:43.318045 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-4a3c372e-04e0-4290-963c-f93ddda28e21 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:43.318958 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-4a3c372e-04e0-4290-963c-f93ddda28e21 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:43.325263 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4a3c372e-04e0-4290-963c-f93ddda28e21 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:43.325801 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4a3c372e-04e0-4290-963c-f93ddda28e21 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:43.326585 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4a3c372e-04e0-4290-963c-f93ddda28e21 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:43.327014 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-4a3c372e-04e0-4290-963c-f93ddda28e21 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:43.356566 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-4a3c372e-04e0-4290-963c-f93ddda28e21 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042268 Dec 16 15:57:43.357264 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 585/1101] 10.222.0.31 () {60 vars in 1342 bytes} [Thu Dec 16 15:57:43 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:57:43.414660 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-0ba1425b-eb95-4481-b876-6249db641b7f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:43.414660 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-0ba1425b-eb95-4481-b876-6249db641b7f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:43.420414 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0ba1425b-eb95-4481-b876-6249db641b7f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:43.420903 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0ba1425b-eb95-4481-b876-6249db641b7f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:43.421819 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0ba1425b-eb95-4481-b876-6249db641b7f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:43.422503 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0ba1425b-eb95-4481-b876-6249db641b7f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:43.448899 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-0ba1425b-eb95-4481-b876-6249db641b7f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Going to try to terminate instance {{(pid=122398) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 15:57:43.466622 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-885775bd-f552-40aa-84a3-8b7d1663c79e req-fb66f8f8-5f32-4fd0-b057-7e43d0afa799 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8c9604f-bac4-43ac-865e-75e3a2edd325", "tag": "f51fbc3e-acde-4d09-b30a-784b2fecbdae"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:57:43.468346 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:57:43.468346 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:57:43.475902 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-885775bd-f552-40aa-84a3-8b7d1663c79e req-fb66f8f8-5f32-4fd0-b057-7e43d0afa799 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:43.476429 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-885775bd-f552-40aa-84a3-8b7d1663c79e req-fb66f8f8-5f32-4fd0-b057-7e43d0afa799 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:43.489124 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-885775bd-f552-40aa-84a3-8b7d1663c79e req-fb66f8f8-5f32-4fd0-b057-7e43d0afa799 service nova] Creating event network-changed:f51fbc3e-acde-4d09-b30a-784b2fecbdae for instance b8c9604f-bac4-43ac-865e-75e3a2edd325 on hv-cinder-78447 Dec 16 15:57:43.494552 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-885775bd-f552-40aa-84a3-8b7d1663c79e req-fb66f8f8-5f32-4fd0-b057-7e43d0afa799 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031956 Dec 16 15:57:43.495417 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 586/1102] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:57:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:57:43.564934 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-0ba1425b-eb95-4481-b876-6249db641b7f tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "DELETE /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 204 len: 0 microversion: 2.20 time: 0.154930 Dec 16 15:57:43.565955 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 517/1103] 10.222.0.31 () {60 vars in 1279 bytes} [Thu Dec 16 15:57:43 2021] DELETE /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 16 15:57:43.574375 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-be98c4b0-d744-432e-92b9-52609c6fd2a3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:43.575355 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-be98c4b0-d744-432e-92b9-52609c6fd2a3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:43.581750 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-be98c4b0-d744-432e-92b9-52609c6fd2a3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:43.582190 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-be98c4b0-d744-432e-92b9-52609c6fd2a3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:43.582969 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-be98c4b0-d744-432e-92b9-52609c6fd2a3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:43.583395 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-be98c4b0-d744-432e-92b9-52609c6fd2a3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:43.731148 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-be98c4b0-d744-432e-92b9-52609c6fd2a3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:43.740430 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-be98c4b0-d744-432e-92b9-52609c6fd2a3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:43.742097 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-be98c4b0-d744-432e-92b9-52609c6fd2a3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:43.743323 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-be98c4b0-d744-432e-92b9-52609c6fd2a3 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1725 microversion: 2.20 time: 0.173110 Dec 16 15:57:43.743877 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 587/1104] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:57:43 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:57:44.762761 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-97437daf-b1b2-430b-921c-aa01fc7fc831 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:44.763401 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-97437daf-b1b2-430b-921c-aa01fc7fc831 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:44.769879 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-97437daf-b1b2-430b-921c-aa01fc7fc831 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:44.770331 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-97437daf-b1b2-430b-921c-aa01fc7fc831 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:44.771118 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-97437daf-b1b2-430b-921c-aa01fc7fc831 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:44.771557 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-97437daf-b1b2-430b-921c-aa01fc7fc831 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:44.909173 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-97437daf-b1b2-430b-921c-aa01fc7fc831 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:44.917126 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-97437daf-b1b2-430b-921c-aa01fc7fc831 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:44.918670 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-97437daf-b1b2-430b-921c-aa01fc7fc831 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:44.919833 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-97437daf-b1b2-430b-921c-aa01fc7fc831 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1725 microversion: 2.20 time: 0.161343 Dec 16 15:57:44.920378 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 518/1105] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:57:44 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:57:45.938506 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-a30aa208-6132-4050-a328-01c2e96bee49 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:45.939137 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-a30aa208-6132-4050-a328-01c2e96bee49 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:45.946335 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a30aa208-6132-4050-a328-01c2e96bee49 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:45.946782 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a30aa208-6132-4050-a328-01c2e96bee49 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:45.947545 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a30aa208-6132-4050-a328-01c2e96bee49 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:45.947788 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-4e63c68c-d67a-4235-9a88-dde5f13ecb35 req-5263b768-8590-4383-912b-a473eb707a61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53cb08f0-26a5-4811-9df7-b5a346757838", "name": "network-vif-deleted", "tag": "18769a46-6816-4b5e-bcc0-d0d8cac455d6"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:57:45.948683 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a30aa208-6132-4050-a328-01c2e96bee49 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:45.950645 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:57:45.950645 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:57:45.963388 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-4e63c68c-d67a-4235-9a88-dde5f13ecb35 req-5263b768-8590-4383-912b-a473eb707a61 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:45.964303 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-4e63c68c-d67a-4235-9a88-dde5f13ecb35 req-5263b768-8590-4383-912b-a473eb707a61 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:45.981097 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-4e63c68c-d67a-4235-9a88-dde5f13ecb35 req-5263b768-8590-4383-912b-a473eb707a61 service nova] Creating event network-vif-deleted:18769a46-6816-4b5e-bcc0-d0d8cac455d6 for instance 53cb08f0-26a5-4811-9df7-b5a346757838 on hv-cinder-78447 Dec 16 15:57:45.989497 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-4e63c68c-d67a-4235-9a88-dde5f13ecb35 req-5263b768-8590-4383-912b-a473eb707a61 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046517 Dec 16 15:57:45.990504 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 519/1106] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:57:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:57:46.015624 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-a30aa208-6132-4050-a328-01c2e96bee49 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:46.023906 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-a30aa208-6132-4050-a328-01c2e96bee49 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:46.025567 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-a30aa208-6132-4050-a328-01c2e96bee49 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cef547b44664cf48870933998504758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbf45043974460803db71f1750aacc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:57:46.026927 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-a30aa208-6132-4050-a328-01c2e96bee49 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 200 len: 1657 microversion: 2.20 time: 0.092183 Dec 16 15:57:46.027813 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 588/1107] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:57:45 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 1657 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:57:47.046311 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-5b1c242a-b277-4999-9f63-0d58adb56e5c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:47.047003 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-5b1c242a-b277-4999-9f63-0d58adb56e5c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:47.054797 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5b1c242a-b277-4999-9f63-0d58adb56e5c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:47.055432 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5b1c242a-b277-4999-9f63-0d58adb56e5c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:47.056449 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5b1c242a-b277-4999-9f63-0d58adb56e5c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:47.056886 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5b1c242a-b277-4999-9f63-0d58adb56e5c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:47.071069 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.wsgi [None req-5b1c242a-b277-4999-9f63-0d58adb56e5c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] HTTP exception thrown: Instance 53cb08f0-26a5-4811-9df7-b5a346757838 could not be found. Dec 16 15:57:47.071675 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-5b1c242a-b277-4999-9f63-0d58adb56e5c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Returning 404 to user: Instance 53cb08f0-26a5-4811-9df7-b5a346757838 could not be found. {{(pid=122398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:57:47.072508 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-5b1c242a-b277-4999-9f63-0d58adb56e5c tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 404 len: 111 microversion: 2.20 time: 0.030807 Dec 16 15:57:47.073071 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 520/1108] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:57:47 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 16 15:57:47.081640 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-d9a61bfa-8816-4c16-ab52-4e8004504f51 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '.version_select at 0x7fed5e8b2af0>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:47.085034 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d9a61bfa-8816-4c16-ab52-4e8004504f51 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [8b3c5eec-32c5-4b64-8bde-0a3d00809fd0] AMQP server on 10.222.0.31:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 15:57:48.106831 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO oslo.messaging._drivers.impl_rabbit [None req-d9a61bfa-8816-4c16-ab52-4e8004504f51 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [8b3c5eec-32c5-4b64-8bde-0a3d00809fd0] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 42298. Dec 16 15:57:48.130109 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-d9a61bfa-8816-4c16-ab52-4e8004504f51 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1931689108" status: 204 len: 0 microversion: 2.20 time: 1.052243 Dec 16 15:57:48.130715 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 589/1109] 10.222.0.31 () {60 vars in 1261 bytes} [Thu Dec 16 15:57:47 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1931689108 => generated 0 bytes in 1053 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 16 15:57:49.934518 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-c8e69efd-489f-4020-a753-4ba0f36e5b23 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:49.935175 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-c8e69efd-489f-4020-a753-4ba0f36e5b23 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:49.941283 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c8e69efd-489f-4020-a753-4ba0f36e5b23 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:49.941756 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c8e69efd-489f-4020-a753-4ba0f36e5b23 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:49.942634 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c8e69efd-489f-4020-a753-4ba0f36e5b23 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:49.943076 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c8e69efd-489f-4020-a753-4ba0f36e5b23 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:49.956588 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.wsgi [None req-c8e69efd-489f-4020-a753-4ba0f36e5b23 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] HTTP exception thrown: Instance 53cb08f0-26a5-4811-9df7-b5a346757838 could not be found. Dec 16 15:57:49.957163 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-c8e69efd-489f-4020-a753-4ba0f36e5b23 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Returning 404 to user: Instance 53cb08f0-26a5-4811-9df7-b5a346757838 could not be found. {{(pid=122398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:57:49.958018 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-c8e69efd-489f-4020-a753-4ba0f36e5b23 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "DELETE /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 404 len: 111 microversion: 2.20 time: 0.027776 Dec 16 15:57:49.958587 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 521/1110] 10.222.0.31 () {60 vars in 1279 bytes} [Thu Dec 16 15:57:49 2021] DELETE /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 16 15:57:49.967529 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-78762753-83e3-45b6-8baf-517d7aa21b17 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:49.968168 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-78762753-83e3-45b6-8baf-517d7aa21b17 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 53cb08f0-26a5-4811-9df7-b5a346757838] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:49.975014 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-78762753-83e3-45b6-8baf-517d7aa21b17 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:49.975471 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-78762753-83e3-45b6-8baf-517d7aa21b17 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:49.976249 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-78762753-83e3-45b6-8baf-517d7aa21b17 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:49.976687 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-78762753-83e3-45b6-8baf-517d7aa21b17 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:49.989500 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.wsgi [None req-78762753-83e3-45b6-8baf-517d7aa21b17 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] HTTP exception thrown: Instance 53cb08f0-26a5-4811-9df7-b5a346757838 could not be found. Dec 16 15:57:49.990126 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-78762753-83e3-45b6-8baf-517d7aa21b17 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Returning 404 to user: Instance 53cb08f0-26a5-4811-9df7-b5a346757838 could not be found. {{(pid=122399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:57:49.991007 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-78762753-83e3-45b6-8baf-517d7aa21b17 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838" status: 404 len: 111 microversion: 2.20 time: 0.028078 Dec 16 15:57:49.991465 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 590/1111] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:57:49 2021] GET /compute/v2.1/servers/53cb08f0-26a5-4811-9df7-b5a346757838 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 16 15:57:51.121536 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-9c32a5be-0eaa-408d-9f9b-978a7a7e41ae tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:51.122053 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-9c32a5be-0eaa-408d-9f9b-978a7a7e41ae tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:51.128693 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9c32a5be-0eaa-408d-9f9b-978a7a7e41ae tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:51.129125 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9c32a5be-0eaa-408d-9f9b-978a7a7e41ae tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:51.129943 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9c32a5be-0eaa-408d-9f9b-978a7a7e41ae tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:51.130371 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9c32a5be-0eaa-408d-9f9b-978a7a7e41ae tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:51.143699 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.wsgi [None req-9c32a5be-0eaa-408d-9f9b-978a7a7e41ae tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] HTTP exception thrown: Instance 635ee3bb-dc82-4d25-95fc-ef55d01f0705 could not be found. Dec 16 15:57:51.144277 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-9c32a5be-0eaa-408d-9f9b-978a7a7e41ae tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Returning 404 to user: Instance 635ee3bb-dc82-4d25-95fc-ef55d01f0705 could not be found. {{(pid=122398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:57:51.145113 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-9c32a5be-0eaa-408d-9f9b-978a7a7e41ae tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "DELETE /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 404 len: 111 microversion: 2.20 time: 0.027377 Dec 16 15:57:51.145676 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 522/1112] 10.222.0.31 () {60 vars in 1279 bytes} [Thu Dec 16 15:57:51 2021] DELETE /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 16 15:57:51.153564 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-71b821a4-1017-4af8-898f-ac6ad6340a95 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:57:51.154171 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-71b821a4-1017-4af8-898f-ac6ad6340a95 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] [instance: 635ee3bb-dc82-4d25-95fc-ef55d01f0705] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:57:51.160831 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-71b821a4-1017-4af8-898f-ac6ad6340a95 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:51.161255 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-71b821a4-1017-4af8-898f-ac6ad6340a95 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:51.162095 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-71b821a4-1017-4af8-898f-ac6ad6340a95 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:57:51.162522 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-71b821a4-1017-4af8-898f-ac6ad6340a95 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:57:51.175479 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.wsgi [None req-71b821a4-1017-4af8-898f-ac6ad6340a95 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] HTTP exception thrown: Instance 635ee3bb-dc82-4d25-95fc-ef55d01f0705 could not be found. Dec 16 15:57:51.176044 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-71b821a4-1017-4af8-898f-ac6ad6340a95 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] Returning 404 to user: Instance 635ee3bb-dc82-4d25-95fc-ef55d01f0705 could not be found. {{(pid=122399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:57:51.176848 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-71b821a4-1017-4af8-898f-ac6ad6340a95 tempest-AttachVolumeShelveTestJSON-1621237037 tempest-AttachVolumeShelveTestJSON-1621237037-project] 10.222.0.31 "GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705" status: 404 len: 111 microversion: 2.20 time: 0.027113 Dec 16 15:57:51.177357 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 591/1113] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Dec 16 15:57:51 2021] GET /compute/v2.1/servers/635ee3bb-dc82-4d25-95fc-ef55d01f0705 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 16 15:58:34.451825 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-d19498f1-99a6-47ef-b0be-d21608db4f05 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Action: 'create', calling method: .version_select at 0x7fed5de093a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-371717404"}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:58:34.466086 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.quota [None req-d19498f1-99a6-47ef-b0be-d21608db4f05 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Getting quotas for project a1354e5edc5f47ae9977e62b72cad47a. Resources: {'key_pairs'} {{(pid=122398) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:58:34.470032 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.quota [None req-d19498f1-99a6-47ef-b0be-d21608db4f05 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Getting quotas for user 3d6fd9a8b1fb42fd932f1cec4e97f123 and project a1354e5edc5f47ae9977e62b72cad47a. Resources: {'key_pairs'} {{(pid=122398) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:58:34.688811 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.quota [None req-d19498f1-99a6-47ef-b0be-d21608db4f05 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Getting quotas for project a1354e5edc5f47ae9977e62b72cad47a. Resources: {'key_pairs'} {{(pid=122398) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:58:34.692461 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.quota [None req-d19498f1-99a6-47ef-b0be-d21608db4f05 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Getting quotas for user 3d6fd9a8b1fb42fd932f1cec4e97f123 and project a1354e5edc5f47ae9977e62b72cad47a. Resources: {'key_pairs'} {{(pid=122398) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:58:34.704988 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-d19498f1-99a6-47ef-b0be-d21608db4f05 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.257136 Dec 16 15:58:34.705599 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 523/1114] 10.222.0.31 () {60 vars in 1157 bytes} [Thu Dec 16 15:58:34 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:58:34.759369 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-c2c2075a-0aed-4d73-a940-8eeee48430b6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-199767842", "imageRef": "b9d196d9-2699-4df0-86f4-86ed5756cf9f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-371717404", "networks": [{"uuid": "51485203-00c5-419d-a44d-06f8f6badd52"}]}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:58:34.811464 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.network.neutron [None req-c2c2075a-0aed-4d73-a940-8eeee48430b6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] validate_networks() for [('51485203-00c5-419d-a44d-06f8f6badd52', None, None, None, None, None)] {{(pid=122399) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 15:58:35.190070 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-c2c2075a-0aed-4d73-a940-8eeee48430b6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Flavor limits 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 15:58:35.190491 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-c2c2075a-0aed-4d73-a940-8eeee48430b6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Image limits 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 15:58:35.190958 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-c2c2075a-0aed-4d73-a940-8eeee48430b6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Flavor pref 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 15:58:35.191331 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-c2c2075a-0aed-4d73-a940-8eeee48430b6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Image pref 0:0:0 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 15:58:35.191735 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.virt.hardware [None req-c2c2075a-0aed-4d73-a940-8eeee48430b6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 15:58:35.201936 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c2c2075a-0aed-4d73-a940-8eeee48430b6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:35.202382 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c2c2075a-0aed-4d73-a940-8eeee48430b6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:35.203222 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c2c2075a-0aed-4d73-a940-8eeee48430b6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:35.203646 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-c2c2075a-0aed-4d73-a940-8eeee48430b6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:35.220329 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-c2c2075a-0aed-4d73-a940-8eeee48430b6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Getting quotas for project a1354e5edc5f47ae9977e62b72cad47a. Resources: {'instances', 'ram', 'cores'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 15:58:35.224361 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.quota [None req-c2c2075a-0aed-4d73-a940-8eeee48430b6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Getting quotas for user 3d6fd9a8b1fb42fd932f1cec4e97f123 and project a1354e5edc5f47ae9977e62b72cad47a. Resources: {'instances', 'ram', 'cores'} {{(pid=122399) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 15:58:35.235370 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-c2c2075a-0aed-4d73-a940-8eeee48430b6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Going to run 1 instances... {{(pid=122399) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 15:58:35.237600 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-c2c2075a-0aed-4d73-a940-8eeee48430b6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9d196d9-2699-4df0-86f4-86ed5756cf9f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 15:58:35.291668 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-c2c2075a-0aed-4d73-a940-8eeee48430b6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.536194 Dec 16 15:58:35.292289 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 592/1115] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Dec 16 15:58:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 15:58:35.302434 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-70a93163-017f-41e9-a19c-f7c63b7adfd3 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:58:35.303051 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-70a93163-017f-41e9-a19c-f7c63b7adfd3 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:58:35.367531 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-70a93163-017f-41e9-a19c-f7c63b7adfd3 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:58:35.374233 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-70a93163-017f-41e9-a19c-f7c63b7adfd3 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1257 microversion: 2.1 time: 0.075840 Dec 16 15:58:35.375047 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 524/1116] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:58:35 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1257 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:58:36.392077 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-03329b1a-6aab-4d79-ad8b-7dad6f811f12 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:58:36.392690 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-03329b1a-6aab-4d79-ad8b-7dad6f811f12 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:58:36.399640 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-03329b1a-6aab-4d79-ad8b-7dad6f811f12 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:36.400092 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-03329b1a-6aab-4d79-ad8b-7dad6f811f12 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:36.400882 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-03329b1a-6aab-4d79-ad8b-7dad6f811f12 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:36.401315 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-03329b1a-6aab-4d79-ad8b-7dad6f811f12 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:36.466546 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-03329b1a-6aab-4d79-ad8b-7dad6f811f12 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:58:36.474144 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-03329b1a-6aab-4d79-ad8b-7dad6f811f12 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1315 microversion: 2.1 time: 0.086556 Dec 16 15:58:36.474721 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 593/1117] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:58:36 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1315 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:58:37.491593 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-812d1056-f955-44f5-ba5c-ecfa833aa97c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:58:37.492922 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-812d1056-f955-44f5-ba5c-ecfa833aa97c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:58:37.501155 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-812d1056-f955-44f5-ba5c-ecfa833aa97c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:37.501669 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-812d1056-f955-44f5-ba5c-ecfa833aa97c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:37.502483 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-812d1056-f955-44f5-ba5c-ecfa833aa97c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:37.502888 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-812d1056-f955-44f5-ba5c-ecfa833aa97c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:37.636417 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-812d1056-f955-44f5-ba5c-ecfa833aa97c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:58:37.643901 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-812d1056-f955-44f5-ba5c-ecfa833aa97c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1357 microversion: 2.1 time: 0.156387 Dec 16 15:58:37.644475 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 525/1118] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:58:37 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:58:38.660123 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-5cf866e3-a65c-4632-ba68-42da0b46e35b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:58:38.660837 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-5cf866e3-a65c-4632-ba68-42da0b46e35b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:58:38.667473 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5cf866e3-a65c-4632-ba68-42da0b46e35b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:38.667927 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5cf866e3-a65c-4632-ba68-42da0b46e35b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:38.668707 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5cf866e3-a65c-4632-ba68-42da0b46e35b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:38.669144 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5cf866e3-a65c-4632-ba68-42da0b46e35b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:38.977539 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-5cf866e3-a65c-4632-ba68-42da0b46e35b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:58:38.985680 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-5cf866e3-a65c-4632-ba68-42da0b46e35b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1357 microversion: 2.1 time: 0.329081 Dec 16 15:58:38.986232 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 594/1119] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:58:38 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1357 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:58:40.003038 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-9a5dd36c-2fa0-4fc0-8a64-1559dfb1d823 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:58:40.003718 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-9a5dd36c-2fa0-4fc0-8a64-1559dfb1d823 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:58:40.010737 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9a5dd36c-2fa0-4fc0-8a64-1559dfb1d823 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:40.011198 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9a5dd36c-2fa0-4fc0-8a64-1559dfb1d823 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:40.011991 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9a5dd36c-2fa0-4fc0-8a64-1559dfb1d823 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:40.012426 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-9a5dd36c-2fa0-4fc0-8a64-1559dfb1d823 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:40.202205 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-9a5dd36c-2fa0-4fc0-8a64-1559dfb1d823 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:58:40.210795 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-9a5dd36c-2fa0-4fc0-8a64-1559dfb1d823 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1357 microversion: 2.1 time: 0.211455 Dec 16 15:58:40.218288 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 526/1120] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:58:39 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1357 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:58:41.229469 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-9614fb03-cbe5-4f0d-accc-b92bb8ae8659 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:58:41.230178 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-9614fb03-cbe5-4f0d-accc-b92bb8ae8659 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:58:41.237627 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9614fb03-cbe5-4f0d-accc-b92bb8ae8659 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:41.238368 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9614fb03-cbe5-4f0d-accc-b92bb8ae8659 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:41.239556 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9614fb03-cbe5-4f0d-accc-b92bb8ae8659 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:41.240141 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9614fb03-cbe5-4f0d-accc-b92bb8ae8659 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:41.391201 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-9614fb03-cbe5-4f0d-accc-b92bb8ae8659 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:58:41.398643 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-9614fb03-cbe5-4f0d-accc-b92bb8ae8659 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1357 microversion: 2.1 time: 0.173775 Dec 16 15:58:41.399207 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 595/1121] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:58:41 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:58:42.415371 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-43cd0b22-d374-4e15-bc6d-c14ee118868c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:58:42.416014 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-43cd0b22-d374-4e15-bc6d-c14ee118868c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:58:42.422568 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-43cd0b22-d374-4e15-bc6d-c14ee118868c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:42.423001 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-43cd0b22-d374-4e15-bc6d-c14ee118868c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:42.423827 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-43cd0b22-d374-4e15-bc6d-c14ee118868c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:42.424250 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-43cd0b22-d374-4e15-bc6d-c14ee118868c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:42.575677 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-43cd0b22-d374-4e15-bc6d-c14ee118868c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:58:42.583935 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-43cd0b22-d374-4e15-bc6d-c14ee118868c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1357 microversion: 2.1 time: 0.172256 Dec 16 15:58:42.584511 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 527/1122] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:58:42 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:58:43.602127 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-11bdabc7-45fe-4c17-bc0a-7c3e48e9c802 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:58:43.602838 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-11bdabc7-45fe-4c17-bc0a-7c3e48e9c802 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:58:43.613907 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-11bdabc7-45fe-4c17-bc0a-7c3e48e9c802 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:43.614341 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-11bdabc7-45fe-4c17-bc0a-7c3e48e9c802 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:43.615139 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-11bdabc7-45fe-4c17-bc0a-7c3e48e9c802 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:43.615548 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-11bdabc7-45fe-4c17-bc0a-7c3e48e9c802 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:43.747491 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-11bdabc7-45fe-4c17-bc0a-7c3e48e9c802 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:58:43.755377 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-11bdabc7-45fe-4c17-bc0a-7c3e48e9c802 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1357 microversion: 2.1 time: 0.157228 Dec 16 15:58:43.755879 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 596/1123] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:58:43 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:58:44.772148 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-7db5720b-0e62-479e-90cf-f3c439d1b06c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:58:44.772720 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-7db5720b-0e62-479e-90cf-f3c439d1b06c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:58:44.779371 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7db5720b-0e62-479e-90cf-f3c439d1b06c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:44.779816 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7db5720b-0e62-479e-90cf-f3c439d1b06c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:44.780588 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7db5720b-0e62-479e-90cf-f3c439d1b06c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:44.781013 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7db5720b-0e62-479e-90cf-f3c439d1b06c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:44.927703 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-7db5720b-0e62-479e-90cf-f3c439d1b06c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:58:44.935768 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-7db5720b-0e62-479e-90cf-f3c439d1b06c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1357 microversion: 2.1 time: 0.167422 Dec 16 15:58:44.936581 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 528/1124] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:58:44 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:58:45.952264 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-519314ab-ebd8-44f2-ac03-6015ffcf9ad9 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:58:45.952973 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-519314ab-ebd8-44f2-ac03-6015ffcf9ad9 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:58:45.959581 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-519314ab-ebd8-44f2-ac03-6015ffcf9ad9 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:45.960024 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-519314ab-ebd8-44f2-ac03-6015ffcf9ad9 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:45.960830 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-519314ab-ebd8-44f2-ac03-6015ffcf9ad9 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:45.961260 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-519314ab-ebd8-44f2-ac03-6015ffcf9ad9 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:46.102695 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-519314ab-ebd8-44f2-ac03-6015ffcf9ad9 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:58:46.110279 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-519314ab-ebd8-44f2-ac03-6015ffcf9ad9 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1357 microversion: 2.1 time: 0.161766 Dec 16 15:58:46.114241 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 597/1125] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:58:45 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:58:47.131353 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-35bc970f-2ad5-4da7-8082-b251b3897102 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:58:47.132320 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-35bc970f-2ad5-4da7-8082-b251b3897102 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:58:47.142903 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-35bc970f-2ad5-4da7-8082-b251b3897102 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:47.143639 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-35bc970f-2ad5-4da7-8082-b251b3897102 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:47.144777 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-35bc970f-2ad5-4da7-8082-b251b3897102 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:47.145203 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-35bc970f-2ad5-4da7-8082-b251b3897102 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:47.277512 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-35bc970f-2ad5-4da7-8082-b251b3897102 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:58:47.285072 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-35bc970f-2ad5-4da7-8082-b251b3897102 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1357 microversion: 2.1 time: 0.160081 Dec 16 15:58:47.285682 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 529/1126] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:58:47 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:58:48.192386 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-15ea0945-5a85-4218-9192-a1d92d80af44 req-169389c0-782f-4b52-958d-77964cfc4236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93f606cd-8124-42ea-9e06-4ed5b5dcccc4", "tag": "8d78ebca-1e6d-4075-9f3a-6c637c11bc0e"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:58:48.194282 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:58:48.194282 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:58:48.204860 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-15ea0945-5a85-4218-9192-a1d92d80af44 req-169389c0-782f-4b52-958d-77964cfc4236 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:48.205434 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-15ea0945-5a85-4218-9192-a1d92d80af44 req-169389c0-782f-4b52-958d-77964cfc4236 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:48.219016 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-15ea0945-5a85-4218-9192-a1d92d80af44 req-169389c0-782f-4b52-958d-77964cfc4236 service nova] Creating event network-changed:8d78ebca-1e6d-4075-9f3a-6c637c11bc0e for instance 93f606cd-8124-42ea-9e06-4ed5b5dcccc4 on hv-cinder-78447 Dec 16 15:58:48.224937 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-15ea0945-5a85-4218-9192-a1d92d80af44 req-169389c0-782f-4b52-958d-77964cfc4236 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036670 Dec 16 15:58:48.225729 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 598/1127] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:58:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:58:48.302139 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-aca324fd-0d72-42b1-a666-80600ec183da tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:58:48.302754 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-aca324fd-0d72-42b1-a666-80600ec183da tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:58:48.308960 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-aca324fd-0d72-42b1-a666-80600ec183da tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:48.309427 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-aca324fd-0d72-42b1-a666-80600ec183da tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:48.310230 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-aca324fd-0d72-42b1-a666-80600ec183da tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:48.310660 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-aca324fd-0d72-42b1-a666-80600ec183da tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:48.444096 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-aca324fd-0d72-42b1-a666-80600ec183da tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:58:48.451828 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-aca324fd-0d72-42b1-a666-80600ec183da tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1357 microversion: 2.1 time: 0.153553 Dec 16 15:58:48.459634 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 530/1128] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:58:48 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:58:49.474478 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-210b70a3-826b-42d4-99d1-388d3ff833fb tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:58:49.475215 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-210b70a3-826b-42d4-99d1-388d3ff833fb tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:58:49.482559 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-210b70a3-826b-42d4-99d1-388d3ff833fb tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:49.483052 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-210b70a3-826b-42d4-99d1-388d3ff833fb tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:49.483921 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-210b70a3-826b-42d4-99d1-388d3ff833fb tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:49.484403 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-210b70a3-826b-42d4-99d1-388d3ff833fb tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:49.621966 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-210b70a3-826b-42d4-99d1-388d3ff833fb tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:58:49.629638 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-210b70a3-826b-42d4-99d1-388d3ff833fb tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1357 microversion: 2.1 time: 0.162627 Dec 16 15:58:49.630205 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 599/1129] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:58:49 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:58:50.648611 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-df4e584d-3fd8-4f1b-8c96-6ad32471108b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:58:50.649220 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-df4e584d-3fd8-4f1b-8c96-6ad32471108b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:58:50.657105 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-df4e584d-3fd8-4f1b-8c96-6ad32471108b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:50.657761 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-df4e584d-3fd8-4f1b-8c96-6ad32471108b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:50.658926 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-df4e584d-3fd8-4f1b-8c96-6ad32471108b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:50.659512 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-df4e584d-3fd8-4f1b-8c96-6ad32471108b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:50.801933 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-df4e584d-3fd8-4f1b-8c96-6ad32471108b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:58:50.809674 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-df4e584d-3fd8-4f1b-8c96-6ad32471108b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1357 microversion: 2.1 time: 0.166079 Dec 16 15:58:50.810252 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 531/1130] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:58:50 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:58:51.826840 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-5c8335a7-1fc0-4474-b18e-c2cc60cd8fdf tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:58:51.827448 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-5c8335a7-1fc0-4474-b18e-c2cc60cd8fdf tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:58:51.834262 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5c8335a7-1fc0-4474-b18e-c2cc60cd8fdf tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:51.834714 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5c8335a7-1fc0-4474-b18e-c2cc60cd8fdf tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:51.835497 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5c8335a7-1fc0-4474-b18e-c2cc60cd8fdf tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:51.835963 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-5c8335a7-1fc0-4474-b18e-c2cc60cd8fdf tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:51.965688 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-5c8335a7-1fc0-4474-b18e-c2cc60cd8fdf tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:58:51.973529 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-5c8335a7-1fc0-4474-b18e-c2cc60cd8fdf tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1357 microversion: 2.1 time: 0.150380 Dec 16 15:58:51.974125 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 600/1131] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:58:51 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:58:52.992765 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-1e586d39-fa0e-41c5-b8e2-7f760d8ddaac tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:58:52.993781 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-1e586d39-fa0e-41c5-b8e2-7f760d8ddaac tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:58:53.003860 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1e586d39-fa0e-41c5-b8e2-7f760d8ddaac tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:53.004560 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1e586d39-fa0e-41c5-b8e2-7f760d8ddaac tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:53.005837 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1e586d39-fa0e-41c5-b8e2-7f760d8ddaac tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:53.006469 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1e586d39-fa0e-41c5-b8e2-7f760d8ddaac tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:53.142387 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-1e586d39-fa0e-41c5-b8e2-7f760d8ddaac tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:58:53.150234 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-1e586d39-fa0e-41c5-b8e2-7f760d8ddaac tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1357 microversion: 2.1 time: 0.163033 Dec 16 15:58:53.150800 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 532/1132] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:58:52 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:58:53.826698 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-4e98f4bc-e1ec-4dc4-b1f1-de0abd70ee05 req-f58a1371-bbf3-484d-afd6-0ed9e8aae07f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93f606cd-8124-42ea-9e06-4ed5b5dcccc4", "name": "network-vif-plugged", "status": "completed", "tag": "8d78ebca-1e6d-4075-9f3a-6c637c11bc0e"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:58:53.828212 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:58:53.828212 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:58:53.835814 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-4e98f4bc-e1ec-4dc4-b1f1-de0abd70ee05 req-f58a1371-bbf3-484d-afd6-0ed9e8aae07f service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:53.836252 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-4e98f4bc-e1ec-4dc4-b1f1-de0abd70ee05 req-f58a1371-bbf3-484d-afd6-0ed9e8aae07f service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:53.847933 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-4e98f4bc-e1ec-4dc4-b1f1-de0abd70ee05 req-f58a1371-bbf3-484d-afd6-0ed9e8aae07f service nova] Creating event network-vif-plugged:8d78ebca-1e6d-4075-9f3a-6c637c11bc0e for instance 93f606cd-8124-42ea-9e06-4ed5b5dcccc4 on hv-cinder-78447 Dec 16 15:58:53.852980 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-4e98f4bc-e1ec-4dc4-b1f1-de0abd70ee05 req-f58a1371-bbf3-484d-afd6-0ed9e8aae07f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030107 Dec 16 15:58:53.853636 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 601/1133] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:58:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:58:54.169457 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-0c7b64a7-31e2-43e3-920f-2cb1771fa684 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:58:54.170372 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-0c7b64a7-31e2-43e3-920f-2cb1771fa684 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:58:54.179135 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0c7b64a7-31e2-43e3-920f-2cb1771fa684 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:54.179762 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0c7b64a7-31e2-43e3-920f-2cb1771fa684 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:54.180836 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0c7b64a7-31e2-43e3-920f-2cb1771fa684 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:54.181462 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-0c7b64a7-31e2-43e3-920f-2cb1771fa684 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:54.595518 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-0c7b64a7-31e2-43e3-920f-2cb1771fa684 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:58:54.605909 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-0c7b64a7-31e2-43e3-920f-2cb1771fa684 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1357 microversion: 2.1 time: 0.441416 Dec 16 15:58:54.606833 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 533/1134] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:58:54 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1357 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:58:55.626018 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-f377541e-f7d9-4741-b95d-dc4a066c1c96 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:58:55.626718 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-f377541e-f7d9-4741-b95d-dc4a066c1c96 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:58:55.633687 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f377541e-f7d9-4741-b95d-dc4a066c1c96 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:55.634138 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f377541e-f7d9-4741-b95d-dc4a066c1c96 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:55.634916 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f377541e-f7d9-4741-b95d-dc4a066c1c96 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:55.635342 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-f377541e-f7d9-4741-b95d-dc4a066c1c96 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:55.772379 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-f377541e-f7d9-4741-b95d-dc4a066c1c96 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:58:55.783123 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-f377541e-f7d9-4741-b95d-dc4a066c1c96 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1548 microversion: 2.1 time: 0.160960 Dec 16 15:58:55.783909 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 602/1135] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:58:55 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:58:55.799665 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-22d375d7-283f-4803-b27c-5e6605544196 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:58:55.800320 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-22d375d7-283f-4803-b27c-5e6605544196 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:58:55.806939 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-22d375d7-283f-4803-b27c-5e6605544196 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:55.807386 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-22d375d7-283f-4803-b27c-5e6605544196 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:55.808160 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-22d375d7-283f-4803-b27c-5e6605544196 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:55.808586 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-22d375d7-283f-4803-b27c-5e6605544196 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:55.942578 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-22d375d7-283f-4803-b27c-5e6605544196 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:58:55.950015 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-22d375d7-283f-4803-b27c-5e6605544196 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1548 microversion: 2.1 time: 0.154093 Dec 16 15:58:55.950589 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 534/1136] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:58:55 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:58:55.965839 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-8d3bbff3-0b18-43b8-bb89-b64dc04e17c5 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:58:55.969124 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:58:55.969124 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:58:55.970174 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-8d3bbff3-0b18-43b8-bb89-b64dc04e17c5 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:58:55.970909 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-8d3bbff3-0b18-43b8-bb89-b64dc04e17c5 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Searching by: {'deleted': False, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a'} {{(pid=122399) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 16 15:58:55.977658 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8d3bbff3-0b18-43b8-bb89-b64dc04e17c5 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:55.978098 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8d3bbff3-0b18-43b8-bb89-b64dc04e17c5 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:55.978967 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8d3bbff3-0b18-43b8-bb89-b64dc04e17c5 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:55.979321 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-8d3bbff3-0b18-43b8-bb89-b64dc04e17c5 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:56.065056 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.multi_cell_list [None req-8d3bbff3-0b18-43b8-bb89-b64dc04e17c5 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122399) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 16 15:58:56.154575 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-8d3bbff3-0b18-43b8-bb89-b64dc04e17c5 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.192652 Dec 16 15:58:56.155168 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 603/1137] 10.222.0.31 () {58 vars in 1124 bytes} [Thu Dec 16 15:58:55 2021] GET /compute/v2.1/servers => generated 342 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:58:56.166726 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-cd08391c-469b-4b49-9120-6787f76b7d95 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:58:56.167680 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-cd08391c-469b-4b49-9120-6787f76b7d95 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:58:56.176039 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cd08391c-469b-4b49-9120-6787f76b7d95 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:56.176479 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cd08391c-469b-4b49-9120-6787f76b7d95 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:56.177242 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cd08391c-469b-4b49-9120-6787f76b7d95 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:56.177693 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-cd08391c-469b-4b49-9120-6787f76b7d95 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:56.311718 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-cd08391c-469b-4b49-9120-6787f76b7d95 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:58:56.319601 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-cd08391c-469b-4b49-9120-6787f76b7d95 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1548 microversion: 2.1 time: 0.158043 Dec 16 15:58:56.320109 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 535/1138] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:58:56 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:58:57.843016 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-58c8a1c3-a27f-4c65-88c7-01e1d9956a19 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0cc5544-61a5-46fe-865a-4fcba5eb9582"}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:58:57.844071 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-58c8a1c3-a27f-4c65-88c7-01e1d9956a19 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:58:57.850798 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-58c8a1c3-a27f-4c65-88c7-01e1d9956a19 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:57.851245 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-58c8a1c3-a27f-4c65-88c7-01e1d9956a19 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:57.852022 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-58c8a1c3-a27f-4c65-88c7-01e1d9956a19 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:58:57.852456 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-58c8a1c3-a27f-4c65-88c7-01e1d9956a19 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:58:58.108874 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-58c8a1c3-a27f-4c65-88c7-01e1d9956a19 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "POST /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269956 Dec 16 15:58:58.109624 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 604/1139] 10.222.0.31 () {60 vars in 1322 bytes} [Thu Dec 16 15:58:57 2021] POST /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:59:04.615496 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-dfca655b-1ccc-45c8-b513-6d9d4ed3aa31 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:59:04.616064 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-dfca655b-1ccc-45c8-b513-6d9d4ed3aa31 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:59:04.625962 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-dfca655b-1ccc-45c8-b513-6d9d4ed3aa31 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:04.626575 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-dfca655b-1ccc-45c8-b513-6d9d4ed3aa31 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:04.627367 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-dfca655b-1ccc-45c8-b513-6d9d4ed3aa31 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:04.627926 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-dfca655b-1ccc-45c8-b513-6d9d4ed3aa31 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:04.765027 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-dfca655b-1ccc-45c8-b513-6d9d4ed3aa31 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:59:04.773550 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-dfca655b-1ccc-45c8-b513-6d9d4ed3aa31 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1594 microversion: 2.1 time: 0.163493 Dec 16 15:59:04.774125 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 536/1140] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:59:04 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1594 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:59:06.462118 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-14378bc8-c80b-4b0a-ad73-e246e9f28d23 req-3e42d773-f7b1-4c4f-8dd1-4add939bf162 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93f606cd-8124-42ea-9e06-4ed5b5dcccc4", "tag": "8d78ebca-1e6d-4075-9f3a-6c637c11bc0e"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:59:06.463934 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:59:06.463934 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:59:06.471365 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-14378bc8-c80b-4b0a-ad73-e246e9f28d23 req-3e42d773-f7b1-4c4f-8dd1-4add939bf162 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:06.471808 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-14378bc8-c80b-4b0a-ad73-e246e9f28d23 req-3e42d773-f7b1-4c4f-8dd1-4add939bf162 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:06.483434 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-14378bc8-c80b-4b0a-ad73-e246e9f28d23 req-3e42d773-f7b1-4c4f-8dd1-4add939bf162 service nova] Creating event network-changed:8d78ebca-1e6d-4075-9f3a-6c637c11bc0e for instance 93f606cd-8124-42ea-9e06-4ed5b5dcccc4 on hv-cinder-78447 Dec 16 15:59:06.488503 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-14378bc8-c80b-4b0a-ad73-e246e9f28d23 req-3e42d773-f7b1-4c4f-8dd1-4add939bf162 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030836 Dec 16 15:59:06.489294 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 605/1141] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:59:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:59:07.501113 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-7a5bb1c0-8efd-4e8e-9037-401591d876d4 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1680142675"}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:59:07.501699 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-7a5bb1c0-8efd-4e8e-9037-401591d876d4 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:59:07.508179 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7a5bb1c0-8efd-4e8e-9037-401591d876d4 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:07.508623 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7a5bb1c0-8efd-4e8e-9037-401591d876d4 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:07.509437 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7a5bb1c0-8efd-4e8e-9037-401591d876d4 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:07.509859 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7a5bb1c0-8efd-4e8e-9037-401591d876d4 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:07.649736 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.network.security_group_api [None req-7a5bb1c0-8efd-4e8e-9037-401591d876d4 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Adding security group e7460c71-8195-4086-92e0-d284a45d9ac6 to port 8d78ebca-1e6d-4075-9f3a-6c637c11bc0e Dec 16 15:59:07.995785 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-7a5bb1c0-8efd-4e8e-9037-401591d876d4 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "POST /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4/action" status: 202 len: 0 microversion: 2.1 time: 0.497432 Dec 16 15:59:07.997157 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 537/1142] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:59:07 2021] POST /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:59:08.006610 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-63897f64-d33a-441c-927f-65db1d1d9cef tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:59:08.007418 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-63897f64-d33a-441c-927f-65db1d1d9cef tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:59:08.014715 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-63897f64-d33a-441c-927f-65db1d1d9cef tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:08.015647 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-63897f64-d33a-441c-927f-65db1d1d9cef tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:08.018770 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-63897f64-d33a-441c-927f-65db1d1d9cef tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:08.020759 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-63897f64-d33a-441c-927f-65db1d1d9cef tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:08.188362 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-63897f64-d33a-441c-927f-65db1d1d9cef tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:59:08.196458 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-63897f64-d33a-441c-927f-65db1d1d9cef tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1758 microversion: 2.1 time: 0.194398 Dec 16 15:59:08.197246 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 606/1143] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:59:08 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1758 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:59:08.503997 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-768e6dc8-923a-4570-b0f9-12e8b9694109 req-62cf2cd1-a7d2-4d90-b21a-ba4bef4663e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93f606cd-8124-42ea-9e06-4ed5b5dcccc4", "tag": "8d78ebca-1e6d-4075-9f3a-6c637c11bc0e"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:59:08.505810 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:59:08.505810 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:59:08.513441 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-768e6dc8-923a-4570-b0f9-12e8b9694109 req-62cf2cd1-a7d2-4d90-b21a-ba4bef4663e2 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:08.513924 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-768e6dc8-923a-4570-b0f9-12e8b9694109 req-62cf2cd1-a7d2-4d90-b21a-ba4bef4663e2 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:08.524997 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-768e6dc8-923a-4570-b0f9-12e8b9694109 req-62cf2cd1-a7d2-4d90-b21a-ba4bef4663e2 service nova] Creating event network-changed:8d78ebca-1e6d-4075-9f3a-6c637c11bc0e for instance 93f606cd-8124-42ea-9e06-4ed5b5dcccc4 on hv-cinder-78447 Dec 16 15:59:08.530062 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-768e6dc8-923a-4570-b0f9-12e8b9694109 req-62cf2cd1-a7d2-4d90-b21a-ba4bef4663e2 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030154 Dec 16 15:59:08.530656 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 538/1144] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:59:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:59:23.223292 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-972a941f-7bf9-48a7-9ed6-68d039a57db3 req-99f30e87-a049-4975-953a-01ce295d31e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8c9604f-bac4-43ac-865e-75e3a2edd325", "tag": "f51fbc3e-acde-4d09-b30a-784b2fecbdae"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:59:23.226747 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-70f09924-a8b7-402c-9b46-d8680bd5f71a tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:59:23.227277 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-70f09924-a8b7-402c-9b46-d8680bd5f71a tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b8c9604f-bac4-43ac-865e-75e3a2edd325] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:59:23.231171 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:59:23.231171 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:59:23.234662 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-70f09924-a8b7-402c-9b46-d8680bd5f71a tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:23.235088 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-70f09924-a8b7-402c-9b46-d8680bd5f71a tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:23.235864 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-70f09924-a8b7-402c-9b46-d8680bd5f71a tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:23.236317 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-70f09924-a8b7-402c-9b46-d8680bd5f71a tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:23.238380 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-972a941f-7bf9-48a7-9ed6-68d039a57db3 req-99f30e87-a049-4975-953a-01ce295d31e8 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:23.239069 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-972a941f-7bf9-48a7-9ed6-68d039a57db3 req-99f30e87-a049-4975-953a-01ce295d31e8 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:23.252528 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-972a941f-7bf9-48a7-9ed6-68d039a57db3 req-99f30e87-a049-4975-953a-01ce295d31e8 service nova] Creating event network-changed:f51fbc3e-acde-4d09-b30a-784b2fecbdae for instance b8c9604f-bac4-43ac-865e-75e3a2edd325 on hv-cinder-78447 Dec 16 15:59:23.258450 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-972a941f-7bf9-48a7-9ed6-68d039a57db3 req-99f30e87-a049-4975-953a-01ce295d31e8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039645 Dec 16 15:59:23.259274 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 539/1145] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:59:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:59:23.261976 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-70f09924-a8b7-402c-9b46-d8680bd5f71a tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b8c9604f-bac4-43ac-865e-75e3a2edd325] Going to try to terminate instance {{(pid=122399) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 15:59:23.348434 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-70f09924-a8b7-402c-9b46-d8680bd5f71a tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "DELETE /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325" status: 204 len: 0 microversion: 2.1 time: 0.132094 Dec 16 15:59:23.352691 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 607/1146] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Dec 16 15:59:23 2021] DELETE /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:59:23.358227 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-c5c6f93e-424d-4d07-b5ad-01462916a8ff tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:59:23.358940 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-c5c6f93e-424d-4d07-b5ad-01462916a8ff tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b8c9604f-bac4-43ac-865e-75e3a2edd325] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:59:23.365455 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c5c6f93e-424d-4d07-b5ad-01462916a8ff tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:23.365901 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c5c6f93e-424d-4d07-b5ad-01462916a8ff tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:23.366708 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c5c6f93e-424d-4d07-b5ad-01462916a8ff tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:23.367139 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c5c6f93e-424d-4d07-b5ad-01462916a8ff tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:23.508112 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-c5c6f93e-424d-4d07-b5ad-01462916a8ff tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:59:23.515726 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-c5c6f93e-424d-4d07-b5ad-01462916a8ff tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325" status: 200 len: 1576 microversion: 2.1 time: 0.161334 Dec 16 15:59:23.516504 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 540/1147] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:59:23 2021] GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:59:24.534293 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-d11f2727-0fe5-4bbb-9997-4c5850fea657 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:59:24.535151 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-d11f2727-0fe5-4bbb-9997-4c5850fea657 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b8c9604f-bac4-43ac-865e-75e3a2edd325] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:59:24.543223 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d11f2727-0fe5-4bbb-9997-4c5850fea657 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:24.543771 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d11f2727-0fe5-4bbb-9997-4c5850fea657 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:24.544721 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d11f2727-0fe5-4bbb-9997-4c5850fea657 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:24.545254 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-d11f2727-0fe5-4bbb-9997-4c5850fea657 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:24.687481 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-d11f2727-0fe5-4bbb-9997-4c5850fea657 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:59:24.695065 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-d11f2727-0fe5-4bbb-9997-4c5850fea657 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325" status: 200 len: 1457 microversion: 2.1 time: 0.165724 Dec 16 15:59:24.695602 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 608/1148] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:59:24 2021] GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325 => generated 1457 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:59:25.474529 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-e1970fd1-2056-448c-932b-57c99525ea1c req-77db9bf5-75eb-48b2-b90a-8a9ec694aa82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c9604f-bac4-43ac-865e-75e3a2edd325", "name": "network-vif-deleted", "tag": "f51fbc3e-acde-4d09-b30a-784b2fecbdae"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:59:25.476434 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:59:25.476434 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:59:25.483430 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-e1970fd1-2056-448c-932b-57c99525ea1c req-77db9bf5-75eb-48b2-b90a-8a9ec694aa82 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:25.483959 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-e1970fd1-2056-448c-932b-57c99525ea1c req-77db9bf5-75eb-48b2-b90a-8a9ec694aa82 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:25.494948 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-e1970fd1-2056-448c-932b-57c99525ea1c req-77db9bf5-75eb-48b2-b90a-8a9ec694aa82 service nova] Creating event network-vif-deleted:f51fbc3e-acde-4d09-b30a-784b2fecbdae for instance b8c9604f-bac4-43ac-865e-75e3a2edd325 on hv-cinder-78447 Dec 16 15:59:25.500167 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-e1970fd1-2056-448c-932b-57c99525ea1c req-77db9bf5-75eb-48b2-b90a-8a9ec694aa82 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095193 Dec 16 15:59:25.500873 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 541/1149] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:59:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:59:25.712124 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-9a55d17b-7b6f-4a26-b484-49e7e2fbb622 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:59:25.712919 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-9a55d17b-7b6f-4a26-b484-49e7e2fbb622 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b8c9604f-bac4-43ac-865e-75e3a2edd325] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:59:25.721119 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9a55d17b-7b6f-4a26-b484-49e7e2fbb622 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:25.721668 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9a55d17b-7b6f-4a26-b484-49e7e2fbb622 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:25.722513 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9a55d17b-7b6f-4a26-b484-49e7e2fbb622 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:25.723013 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9a55d17b-7b6f-4a26-b484-49e7e2fbb622 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:25.758913 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9a55d17b-7b6f-4a26-b484-49e7e2fbb622 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:25.759827 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-9a55d17b-7b6f-4a26-b484-49e7e2fbb622 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:25.760714 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.objects.instance [None req-9a55d17b-7b6f-4a26-b484-49e7e2fbb622 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lazy-loading 'fault' on Instance uuid b8c9604f-bac4-43ac-865e-75e3a2edd325 {{(pid=122399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:59:25.804725 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-9a55d17b-7b6f-4a26-b484-49e7e2fbb622 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:59:25.812708 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-9a55d17b-7b6f-4a26-b484-49e7e2fbb622 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325" status: 200 len: 1230 microversion: 2.1 time: 0.104379 Dec 16 15:59:25.813389 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 609/1150] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:59:25 2021] GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325 => generated 1230 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:59:26.832144 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-2324a368-09f9-4e92-a731-d5430f8efeeb tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:59:26.832986 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-2324a368-09f9-4e92-a731-d5430f8efeeb tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b8c9604f-bac4-43ac-865e-75e3a2edd325] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:59:26.840966 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2324a368-09f9-4e92-a731-d5430f8efeeb tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:26.841497 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2324a368-09f9-4e92-a731-d5430f8efeeb tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:26.842421 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2324a368-09f9-4e92-a731-d5430f8efeeb tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:26.842961 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-2324a368-09f9-4e92-a731-d5430f8efeeb tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:26.857447 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.wsgi [None req-2324a368-09f9-4e92-a731-d5430f8efeeb tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] HTTP exception thrown: Instance b8c9604f-bac4-43ac-865e-75e3a2edd325 could not be found. Dec 16 15:59:26.858039 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-2324a368-09f9-4e92-a731-d5430f8efeeb tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Returning 404 to user: Instance b8c9604f-bac4-43ac-865e-75e3a2edd325 could not be found. {{(pid=122398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:59:26.858845 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-2324a368-09f9-4e92-a731-d5430f8efeeb tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325" status: 404 len: 111 microversion: 2.1 time: 0.032120 Dec 16 15:59:26.859370 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 542/1151] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:59:26 2021] GET /compute/v2.1/servers/b8c9604f-bac4-43ac-865e-75e3a2edd325 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:59:30.246539 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-a93a759b-4a6b-43d6-bfdb-622403fa6dd1 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:59:30.247076 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-a93a759b-4a6b-43d6-bfdb-622403fa6dd1 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b60467c9-0dcb-419d-ab98-c48a36d7b7d5] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:59:30.249354 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-1ee8395d-7726-4cf9-b476-17c034259d82 req-d0a187e9-b134-451b-811c-9a9ae7010aca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b60467c9-0dcb-419d-ab98-c48a36d7b7d5", "tag": "f8559e41-ad86-4e2d-963f-f8c7641fc223"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:59:30.250950 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:59:30.250950 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 15:59:30.253566 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a93a759b-4a6b-43d6-bfdb-622403fa6dd1 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:30.254021 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a93a759b-4a6b-43d6-bfdb-622403fa6dd1 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:30.254798 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a93a759b-4a6b-43d6-bfdb-622403fa6dd1 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:30.255417 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-a93a759b-4a6b-43d6-bfdb-622403fa6dd1 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:30.258837 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-1ee8395d-7726-4cf9-b476-17c034259d82 req-d0a187e9-b134-451b-811c-9a9ae7010aca service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:30.259839 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-1ee8395d-7726-4cf9-b476-17c034259d82 req-d0a187e9-b134-451b-811c-9a9ae7010aca service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:30.271206 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-1ee8395d-7726-4cf9-b476-17c034259d82 req-d0a187e9-b134-451b-811c-9a9ae7010aca service nova] Creating event network-changed:f8559e41-ad86-4e2d-963f-f8c7641fc223 for instance b60467c9-0dcb-419d-ab98-c48a36d7b7d5 on hv-cinder-78447 Dec 16 15:59:30.277502 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-1ee8395d-7726-4cf9-b476-17c034259d82 req-d0a187e9-b134-451b-811c-9a9ae7010aca service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032095 Dec 16 15:59:30.278814 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 543/1152] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:59:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:59:30.282641 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-a93a759b-4a6b-43d6-bfdb-622403fa6dd1 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b60467c9-0dcb-419d-ab98-c48a36d7b7d5] Going to try to terminate instance {{(pid=122399) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 15:59:30.361544 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-a93a759b-4a6b-43d6-bfdb-622403fa6dd1 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "DELETE /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5" status: 204 len: 0 microversion: 2.1 time: 0.118489 Dec 16 15:59:30.362936 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 610/1153] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Dec 16 15:59:30 2021] DELETE /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:59:30.371287 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-1528adc4-78a4-44c8-a504-019832d09bc1 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:59:30.372259 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-1528adc4-78a4-44c8-a504-019832d09bc1 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b60467c9-0dcb-419d-ab98-c48a36d7b7d5] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:59:30.380590 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1528adc4-78a4-44c8-a504-019832d09bc1 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:30.381034 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1528adc4-78a4-44c8-a504-019832d09bc1 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:30.381845 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1528adc4-78a4-44c8-a504-019832d09bc1 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:30.382267 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-1528adc4-78a4-44c8-a504-019832d09bc1 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:30.523058 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-1528adc4-78a4-44c8-a504-019832d09bc1 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:59:30.531636 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-1528adc4-78a4-44c8-a504-019832d09bc1 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5" status: 200 len: 1574 microversion: 2.1 time: 0.164469 Dec 16 15:59:30.532209 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 544/1154] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:59:30 2021] GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5 => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:59:30.864320 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-94ae52dd-6309-4042-9c31-1ebc0e108da6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:59:30.865509 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-94ae52dd-6309-4042-9c31-1ebc0e108da6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:59:30.871440 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-94ae52dd-6309-4042-9c31-1ebc0e108da6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:30.871887 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-94ae52dd-6309-4042-9c31-1ebc0e108da6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:30.872712 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-94ae52dd-6309-4042-9c31-1ebc0e108da6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:30.873170 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-94ae52dd-6309-4042-9c31-1ebc0e108da6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:30.945049 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-94ae52dd-6309-4042-9c31-1ebc0e108da6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "POST /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4/action" status: 202 len: 0 microversion: 2.1 time: 0.084749 Dec 16 15:59:30.948768 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 611/1155] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 15:59:30 2021] POST /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:59:30.954249 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-7d152325-9d40-4f9d-8811-e2566a018172 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:59:30.954949 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-7d152325-9d40-4f9d-8811-e2566a018172 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:59:30.961076 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7d152325-9d40-4f9d-8811-e2566a018172 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:30.961594 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7d152325-9d40-4f9d-8811-e2566a018172 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:30.962428 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7d152325-9d40-4f9d-8811-e2566a018172 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:30.962860 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-7d152325-9d40-4f9d-8811-e2566a018172 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:31.126131 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-7d152325-9d40-4f9d-8811-e2566a018172 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:59:31.134610 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-7d152325-9d40-4f9d-8811-e2566a018172 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1750 microversion: 2.1 time: 0.183911 Dec 16 15:59:31.135198 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 545/1156] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:59:30 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1750 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:59:31.549238 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-e5b8dd13-0350-42aa-99c7-cbb9612d11c5 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:59:31.549970 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-e5b8dd13-0350-42aa-99c7-cbb9612d11c5 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b60467c9-0dcb-419d-ab98-c48a36d7b7d5] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:59:31.556499 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e5b8dd13-0350-42aa-99c7-cbb9612d11c5 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:31.556954 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e5b8dd13-0350-42aa-99c7-cbb9612d11c5 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:31.557786 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e5b8dd13-0350-42aa-99c7-cbb9612d11c5 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:31.558221 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-e5b8dd13-0350-42aa-99c7-cbb9612d11c5 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:31.695725 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-e5b8dd13-0350-42aa-99c7-cbb9612d11c5 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:59:31.705313 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-e5b8dd13-0350-42aa-99c7-cbb9612d11c5 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5" status: 200 len: 1456 microversion: 2.1 time: 0.160642 Dec 16 15:59:31.705968 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 612/1157] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:59:31 2021] GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5 => generated 1456 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:59:32.152372 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-5837d671-bc01-40be-992a-dc99cbac9f30 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:59:32.153063 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-5837d671-bc01-40be-992a-dc99cbac9f30 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:59:32.159396 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5837d671-bc01-40be-992a-dc99cbac9f30 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:32.159845 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5837d671-bc01-40be-992a-dc99cbac9f30 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:32.160660 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5837d671-bc01-40be-992a-dc99cbac9f30 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:32.161091 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-5837d671-bc01-40be-992a-dc99cbac9f30 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:32.303176 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-5837d671-bc01-40be-992a-dc99cbac9f30 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:59:32.311131 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-5837d671-bc01-40be-992a-dc99cbac9f30 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1755 microversion: 2.1 time: 0.162631 Dec 16 15:59:32.311715 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 546/1158] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:59:32 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:59:32.590239 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-45a4602f-0d8d-47ef-be23-614ced51e392 req-59402afa-1c3a-4c12-a643-9a20c11b2f8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b60467c9-0dcb-419d-ab98-c48a36d7b7d5", "name": "network-vif-deleted", "tag": "f8559e41-ad86-4e2d-963f-f8c7641fc223"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 15:59:32.591762 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:59:32.591762 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 15:59:32.599171 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-45a4602f-0d8d-47ef-be23-614ced51e392 req-59402afa-1c3a-4c12-a643-9a20c11b2f8f service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:32.599614 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-45a4602f-0d8d-47ef-be23-614ced51e392 req-59402afa-1c3a-4c12-a643-9a20c11b2f8f service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:32.610460 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-45a4602f-0d8d-47ef-be23-614ced51e392 req-59402afa-1c3a-4c12-a643-9a20c11b2f8f service nova] Creating event network-vif-deleted:f8559e41-ad86-4e2d-963f-f8c7641fc223 for instance b60467c9-0dcb-419d-ab98-c48a36d7b7d5 on hv-cinder-78447 Dec 16 15:59:32.615526 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-45a4602f-0d8d-47ef-be23-614ced51e392 req-59402afa-1c3a-4c12-a643-9a20c11b2f8f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029265 Dec 16 15:59:32.616138 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 613/1159] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 15:59:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:59:32.726581 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-4f1379f5-e49e-4f96-a1b9-e97918846ba6 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:59:32.727565 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-4f1379f5-e49e-4f96-a1b9-e97918846ba6 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b60467c9-0dcb-419d-ab98-c48a36d7b7d5] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:59:32.737701 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4f1379f5-e49e-4f96-a1b9-e97918846ba6 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:32.738439 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4f1379f5-e49e-4f96-a1b9-e97918846ba6 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:32.739697 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4f1379f5-e49e-4f96-a1b9-e97918846ba6 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:32.740412 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-4f1379f5-e49e-4f96-a1b9-e97918846ba6 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:32.801149 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-4f1379f5-e49e-4f96-a1b9-e97918846ba6 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fd364ddd594b9eb5fe5ffad72ac32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afea3407ef84fafa658a82512fb4d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:59:32.811160 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-4f1379f5-e49e-4f96-a1b9-e97918846ba6 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5" status: 200 len: 1225 microversion: 2.1 time: 0.090878 Dec 16 15:59:32.811728 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 547/1160] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:59:32 2021] GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:59:33.328136 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-7c893c95-9cf2-4107-83df-2d638334636d tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:59:33.328827 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-7c893c95-9cf2-4107-83df-2d638334636d tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:59:33.335176 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7c893c95-9cf2-4107-83df-2d638334636d tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:33.335628 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7c893c95-9cf2-4107-83df-2d638334636d tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:33.336404 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7c893c95-9cf2-4107-83df-2d638334636d tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:33.336805 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-7c893c95-9cf2-4107-83df-2d638334636d tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:33.485943 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-7c893c95-9cf2-4107-83df-2d638334636d tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:59:33.494438 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-7c893c95-9cf2-4107-83df-2d638334636d tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1755 microversion: 2.1 time: 0.170439 Dec 16 15:59:33.495008 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 614/1161] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:59:33 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:59:33.827751 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-431269d9-5f2d-47fe-b3e5-3319f5b2c512 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:59:33.828379 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-431269d9-5f2d-47fe-b3e5-3319f5b2c512 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: b60467c9-0dcb-419d-ab98-c48a36d7b7d5] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:59:33.834849 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-431269d9-5f2d-47fe-b3e5-3319f5b2c512 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:33.835298 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-431269d9-5f2d-47fe-b3e5-3319f5b2c512 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:33.836080 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-431269d9-5f2d-47fe-b3e5-3319f5b2c512 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:33.836511 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-431269d9-5f2d-47fe-b3e5-3319f5b2c512 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:33.849991 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.wsgi [None req-431269d9-5f2d-47fe-b3e5-3319f5b2c512 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] HTTP exception thrown: Instance b60467c9-0dcb-419d-ab98-c48a36d7b7d5 could not be found. Dec 16 15:59:33.850575 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-431269d9-5f2d-47fe-b3e5-3319f5b2c512 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Returning 404 to user: Instance b60467c9-0dcb-419d-ab98-c48a36d7b7d5 could not be found. {{(pid=122398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:59:33.851390 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-431269d9-5f2d-47fe-b3e5-3319f5b2c512 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5" status: 404 len: 111 microversion: 2.1 time: 0.027468 Dec 16 15:59:33.851914 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 548/1162] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:59:33 2021] GET /compute/v2.1/servers/b60467c9-0dcb-419d-ab98-c48a36d7b7d5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:59:34.321068 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-56f413e3-7f67-428a-8334-781e31634de7 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:59:34.321713 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-56f413e3-7f67-428a-8334-781e31634de7 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: d87f6b70-6ea0-48c1-b18c-59052e3ff9d3] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:59:34.328360 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-56f413e3-7f67-428a-8334-781e31634de7 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:34.328804 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-56f413e3-7f67-428a-8334-781e31634de7 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:34.329681 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-56f413e3-7f67-428a-8334-781e31634de7 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:34.330059 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-56f413e3-7f67-428a-8334-781e31634de7 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:34.343525 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.wsgi [None req-56f413e3-7f67-428a-8334-781e31634de7 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] HTTP exception thrown: Instance d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 could not be found. Dec 16 15:59:34.344099 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-56f413e3-7f67-428a-8334-781e31634de7 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Returning 404 to user: Instance d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 could not be found. {{(pid=122399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:59:34.344902 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-56f413e3-7f67-428a-8334-781e31634de7 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "DELETE /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3" status: 404 len: 111 microversion: 2.1 time: 0.027661 Dec 16 15:59:34.345397 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 615/1163] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Dec 16 15:59:34 2021] DELETE /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:59:34.353553 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-8a2011b7-98aa-4298-b22e-88587165c369 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:59:34.354160 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-8a2011b7-98aa-4298-b22e-88587165c369 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] [instance: d87f6b70-6ea0-48c1-b18c-59052e3ff9d3] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:59:34.360576 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8a2011b7-98aa-4298-b22e-88587165c369 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:34.361014 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8a2011b7-98aa-4298-b22e-88587165c369 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:34.361811 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8a2011b7-98aa-4298-b22e-88587165c369 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:34.362231 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-8a2011b7-98aa-4298-b22e-88587165c369 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:34.375469 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.wsgi [None req-8a2011b7-98aa-4298-b22e-88587165c369 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] HTTP exception thrown: Instance d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 could not be found. Dec 16 15:59:34.376042 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-8a2011b7-98aa-4298-b22e-88587165c369 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Returning 404 to user: Instance d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 could not be found. {{(pid=122398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 15:59:34.376818 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-8a2011b7-98aa-4298-b22e-88587165c369 tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3" status: 404 len: 111 microversion: 2.1 time: 0.027165 Dec 16 15:59:34.377339 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 549/1164] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:59:34 2021] GET /compute/v2.1/servers/d87f6b70-6ea0-48c1-b18c-59052e3ff9d3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:59:34.511677 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-2b94889d-843c-45e7-bbbb-234ba93e436b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:59:34.512313 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-2b94889d-843c-45e7-bbbb-234ba93e436b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:59:34.518746 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2b94889d-843c-45e7-bbbb-234ba93e436b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:34.519200 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2b94889d-843c-45e7-bbbb-234ba93e436b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:34.519977 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2b94889d-843c-45e7-bbbb-234ba93e436b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:34.520414 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-2b94889d-843c-45e7-bbbb-234ba93e436b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:34.667643 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-2b94889d-843c-45e7-bbbb-234ba93e436b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:59:34.675550 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-2b94889d-843c-45e7-bbbb-234ba93e436b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1755 microversion: 2.1 time: 0.167755 Dec 16 15:59:34.676113 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 616/1165] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:59:34 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:59:35.682415 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-b4340064-a214-4375-a693-69ec545889db tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] Calling method '.version_select at 0x7fed5ddc3d30>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:59:35.699609 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-6454d2a6-be93-4737-a914-df7e4bcbd45c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:59:35.700269 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-6454d2a6-be93-4737-a914-df7e4bcbd45c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:59:35.704136 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-b4340064-a214-4375-a693-69ec545889db tempest-TestVolumeBootPattern-764999750 tempest-TestVolumeBootPattern-764999750-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-824262971" status: 202 len: 0 microversion: 2.1 time: 0.025657 Dec 16 15:59:35.704780 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 550/1166] 10.222.0.31 () {58 vars in 1259 bytes} [Thu Dec 16 15:59:35 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-824262971 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:59:35.709486 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6454d2a6-be93-4737-a914-df7e4bcbd45c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:35.710608 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6454d2a6-be93-4737-a914-df7e4bcbd45c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:35.711803 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6454d2a6-be93-4737-a914-df7e4bcbd45c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:35.711803 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6454d2a6-be93-4737-a914-df7e4bcbd45c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:35.873324 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-6454d2a6-be93-4737-a914-df7e4bcbd45c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:59:35.882000 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-6454d2a6-be93-4737-a914-df7e4bcbd45c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1755 microversion: 2.1 time: 0.193831 Dec 16 15:59:35.890754 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 617/1167] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:59:35 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1755 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:59:36.899330 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-b96e6454-7370-4c44-8f91-6d035c87f04c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:59:36.899923 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-b96e6454-7370-4c44-8f91-6d035c87f04c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:59:36.915141 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b96e6454-7370-4c44-8f91-6d035c87f04c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:36.915584 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b96e6454-7370-4c44-8f91-6d035c87f04c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:36.916358 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b96e6454-7370-4c44-8f91-6d035c87f04c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:36.916789 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-b96e6454-7370-4c44-8f91-6d035c87f04c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:37.063638 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-b96e6454-7370-4c44-8f91-6d035c87f04c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:59:37.072202 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-b96e6454-7370-4c44-8f91-6d035c87f04c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1755 microversion: 2.1 time: 0.176515 Dec 16 15:59:37.072828 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 551/1168] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:59:36 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:59:38.088648 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-6d450872-25b6-406f-a8c2-7a42338e64e6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:59:38.089263 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-6d450872-25b6-406f-a8c2-7a42338e64e6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:59:38.096760 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6d450872-25b6-406f-a8c2-7a42338e64e6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:38.097208 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6d450872-25b6-406f-a8c2-7a42338e64e6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:38.098057 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6d450872-25b6-406f-a8c2-7a42338e64e6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:38.098489 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-6d450872-25b6-406f-a8c2-7a42338e64e6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:38.375730 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-6d450872-25b6-406f-a8c2-7a42338e64e6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:59:38.383812 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-6d450872-25b6-406f-a8c2-7a42338e64e6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1755 microversion: 2.1 time: 0.298860 Dec 16 15:59:38.384326 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 618/1169] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:59:38 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1755 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:59:39.400786 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-ed08c9b2-0604-4d0b-815d-fdd5ef92c017 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:59:39.401356 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-ed08c9b2-0604-4d0b-815d-fdd5ef92c017 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:59:39.408730 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ed08c9b2-0604-4d0b-815d-fdd5ef92c017 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:39.409161 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ed08c9b2-0604-4d0b-815d-fdd5ef92c017 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:39.409994 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ed08c9b2-0604-4d0b-815d-fdd5ef92c017 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:39.410605 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ed08c9b2-0604-4d0b-815d-fdd5ef92c017 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:39.558063 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-ed08c9b2-0604-4d0b-815d-fdd5ef92c017 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:59:39.566081 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-ed08c9b2-0604-4d0b-815d-fdd5ef92c017 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1755 microversion: 2.1 time: 0.169195 Dec 16 15:59:39.566638 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 552/1170] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:59:39 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:59:40.583518 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-87620789-ee8e-4f69-9a7c-5f9282be24dc tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:59:40.584832 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-87620789-ee8e-4f69-9a7c-5f9282be24dc tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:59:40.591374 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-87620789-ee8e-4f69-9a7c-5f9282be24dc tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:40.591763 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-87620789-ee8e-4f69-9a7c-5f9282be24dc tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:40.592550 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-87620789-ee8e-4f69-9a7c-5f9282be24dc tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:40.592973 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-87620789-ee8e-4f69-9a7c-5f9282be24dc tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:40.737129 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-87620789-ee8e-4f69-9a7c-5f9282be24dc tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:59:40.745045 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-87620789-ee8e-4f69-9a7c-5f9282be24dc tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1755 microversion: 2.1 time: 0.165309 Dec 16 15:59:40.745748 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 619/1171] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:59:40 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:59:41.762870 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-19d3b6fb-655d-4713-8d70-08e0e990bca6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:59:41.763582 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-19d3b6fb-655d-4713-8d70-08e0e990bca6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:59:41.770577 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-19d3b6fb-655d-4713-8d70-08e0e990bca6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:41.771356 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-19d3b6fb-655d-4713-8d70-08e0e990bca6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:41.772338 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-19d3b6fb-655d-4713-8d70-08e0e990bca6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:41.773025 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-19d3b6fb-655d-4713-8d70-08e0e990bca6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:41.959626 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-19d3b6fb-655d-4713-8d70-08e0e990bca6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:59:41.970459 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-19d3b6fb-655d-4713-8d70-08e0e990bca6 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1755 microversion: 2.1 time: 0.211429 Dec 16 15:59:41.971054 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 553/1172] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:59:41 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1755 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:59:42.987528 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-41f31841-c85c-417a-8837-8bcdf228b9fe tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 15:59:42.988133 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-41f31841-c85c-417a-8837-8bcdf228b9fe tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 15:59:42.995601 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-41f31841-c85c-417a-8837-8bcdf228b9fe tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:42.996019 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-41f31841-c85c-417a-8837-8bcdf228b9fe tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:42.996826 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-41f31841-c85c-417a-8837-8bcdf228b9fe tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 15:59:42.997250 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-41f31841-c85c-417a-8837-8bcdf228b9fe tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 15:59:43.143127 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-41f31841-c85c-417a-8837-8bcdf228b9fe tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 15:59:43.151279 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-41f31841-c85c-417a-8837-8bcdf228b9fe tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1758 microversion: 2.1 time: 0.167418 Dec 16 15:59:43.151905 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 620/1173] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 15:59:42 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 16:00:16.161573 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-ad62f510-2bd8-4a62-8cbc-dad5776d0bdb tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1680142675"}} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 16:00:16.162421 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-ad62f510-2bd8-4a62-8cbc-dad5776d0bdb tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 16:00:16.170670 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ad62f510-2bd8-4a62-8cbc-dad5776d0bdb tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 16:00:16.171263 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ad62f510-2bd8-4a62-8cbc-dad5776d0bdb tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 16:00:16.172292 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ad62f510-2bd8-4a62-8cbc-dad5776d0bdb tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 16:00:16.172965 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ad62f510-2bd8-4a62-8cbc-dad5776d0bdb tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 16:00:16.303256 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.network.security_group_api [None req-ad62f510-2bd8-4a62-8cbc-dad5776d0bdb tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Removing security group e7460c71-8195-4086-92e0-d284a45d9ac6 from port 8d78ebca-1e6d-4075-9f3a-6c637c11bc0e Dec 16 16:00:16.663696 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-ad62f510-2bd8-4a62-8cbc-dad5776d0bdb tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "POST /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4/action" status: 202 len: 0 microversion: 2.1 time: 0.507365 Dec 16 16:00:16.665168 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 554/1174] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Dec 16 16:00:16 2021] POST /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 16:00:16.908240 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [req-a9dd208a-5a08-461c-a2cb-de612cae5b70 req-dd15bfb1-e846-4ce2-ada3-738661e74183 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93f606cd-8124-42ea-9e06-4ed5b5dcccc4", "tag": "8d78ebca-1e6d-4075-9f3a-6c637c11bc0e"}]} {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 16:00:16.911016 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 16:00:16.911016 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: warnings.warn(msg) Dec 16 16:00:16.918771 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-a9dd208a-5a08-461c-a2cb-de612cae5b70 req-dd15bfb1-e846-4ce2-ada3-738661e74183 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 16:00:16.919352 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [req-a9dd208a-5a08-461c-a2cb-de612cae5b70 req-dd15bfb1-e846-4ce2-ada3-738661e74183 service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 16:00:16.931272 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.compute.server_external_events [req-a9dd208a-5a08-461c-a2cb-de612cae5b70 req-dd15bfb1-e846-4ce2-ada3-738661e74183 service nova] Creating event network-changed:8d78ebca-1e6d-4075-9f3a-6c637c11bc0e for instance 93f606cd-8124-42ea-9e06-4ed5b5dcccc4 on hv-cinder-78447 Dec 16 16:00:16.937181 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [req-a9dd208a-5a08-461c-a2cb-de612cae5b70 req-dd15bfb1-e846-4ce2-ada3-738661e74183 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.267132 Dec 16 16:00:16.938094 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 621/1175] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 16:00:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 16:00:17.736877 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-dccffac9-1d09-4514-b72e-9fac0b3eb879 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 16:00:17.737449 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-dccffac9-1d09-4514-b72e-9fac0b3eb879 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 16:00:17.743463 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-dccffac9-1d09-4514-b72e-9fac0b3eb879 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 16:00:17.743900 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-dccffac9-1d09-4514-b72e-9fac0b3eb879 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 16:00:17.744681 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-dccffac9-1d09-4514-b72e-9fac0b3eb879 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 16:00:17.745083 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-dccffac9-1d09-4514-b72e-9fac0b3eb879 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 16:00:17.822666 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.objects.instance [None req-dccffac9-1d09-4514-b72e-9fac0b3eb879 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lazy-loading 'services' on Instance uuid 93f606cd-8124-42ea-9e06-4ed5b5dcccc4 {{(pid=122398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 16:00:17.894400 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-dccffac9-1d09-4514-b72e-9fac0b3eb879 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "DELETE /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4/os-volume_attachments/a0cc5544-61a5-46fe-865a-4fcba5eb9582" status: 202 len: 0 microversion: 2.1 time: 0.161815 Dec 16 16:00:17.894995 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 555/1176] 10.222.0.31 () {58 vars in 1415 bytes} [Thu Dec 16 16:00:17 2021] DELETE /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4/os-volume_attachments/a0cc5544-61a5-46fe-865a-4fcba5eb9582 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 16:00:17.906207 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-761b81cc-f2ef-4691-93e4-2822b56e28fe tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 16:00:17.907258 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-761b81cc-f2ef-4691-93e4-2822b56e28fe tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 16:00:17.913801 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-761b81cc-f2ef-4691-93e4-2822b56e28fe tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 16:00:17.914483 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-761b81cc-f2ef-4691-93e4-2822b56e28fe tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 16:00:17.915042 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-761b81cc-f2ef-4691-93e4-2822b56e28fe tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 16:00:17.915652 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-761b81cc-f2ef-4691-93e4-2822b56e28fe tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 16:00:17.950548 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-761b81cc-f2ef-4691-93e4-2822b56e28fe tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050736 Dec 16 16:00:17.951153 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 622/1177] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Dec 16 16:00:17 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 16:00:18.964584 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-e1e84950-be7a-4ea2-8e3f-fca10c542c69 req-73d58310-76aa-463b-9c7b-eef1ccb3d63b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93f606cd-8124-42ea-9e06-4ed5b5dcccc4", "tag": "8d78ebca-1e6d-4075-9f3a-6c637c11bc0e"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 16:00:18.967256 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-80817cd8-1ca9-4770-9e8b-7fabd9fa8514 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 16:00:18.968000 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 16:00:18.968000 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 16:00:18.968721 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-80817cd8-1ca9-4770-9e8b-7fabd9fa8514 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 16:00:18.975757 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-80817cd8-1ca9-4770-9e8b-7fabd9fa8514 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 16:00:18.976242 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-80817cd8-1ca9-4770-9e8b-7fabd9fa8514 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 16:00:18.976405 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-e1e84950-be7a-4ea2-8e3f-fca10c542c69 req-73d58310-76aa-463b-9c7b-eef1ccb3d63b service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 16:00:18.976828 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-e1e84950-be7a-4ea2-8e3f-fca10c542c69 req-73d58310-76aa-463b-9c7b-eef1ccb3d63b service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 16:00:18.976986 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-80817cd8-1ca9-4770-9e8b-7fabd9fa8514 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 16:00:18.977443 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-80817cd8-1ca9-4770-9e8b-7fabd9fa8514 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 16:00:18.987861 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-e1e84950-be7a-4ea2-8e3f-fca10c542c69 req-73d58310-76aa-463b-9c7b-eef1ccb3d63b service nova] Creating event network-changed:8d78ebca-1e6d-4075-9f3a-6c637c11bc0e for instance 93f606cd-8124-42ea-9e06-4ed5b5dcccc4 on hv-cinder-78447 Dec 16 16:00:18.992862 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-e1e84950-be7a-4ea2-8e3f-fca10c542c69 req-73d58310-76aa-463b-9c7b-eef1ccb3d63b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035961 Dec 16 16:00:18.993435 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 556/1178] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 16:00:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 16:00:19.006431 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-80817cd8-1ca9-4770-9e8b-7fabd9fa8514 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046049 Dec 16 16:00:19.006965 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 623/1179] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Dec 16 16:00:18 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 16:00:19.017655 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-c0cc90e1-47c6-4522-8d68-577d672bbd6b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 16:00:19.018239 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-c0cc90e1-47c6-4522-8d68-577d672bbd6b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 16:00:19.024514 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c0cc90e1-47c6-4522-8d68-577d672bbd6b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 16:00:19.024992 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c0cc90e1-47c6-4522-8d68-577d672bbd6b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 16:00:19.025833 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c0cc90e1-47c6-4522-8d68-577d672bbd6b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 16:00:19.026263 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-c0cc90e1-47c6-4522-8d68-577d672bbd6b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 16:00:19.101019 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.wsgi [None req-c0cc90e1-47c6-4522-8d68-577d672bbd6b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] HTTP exception thrown: Instance 93f606cd-8124-42ea-9e06-4ed5b5dcccc4 is not attached to volume a0cc5544-61a5-46fe-865a-4fcba5eb9582 Dec 16 16:00:19.101659 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-c0cc90e1-47c6-4522-8d68-577d672bbd6b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Returning 404 to user: Instance 93f606cd-8124-42ea-9e06-4ed5b5dcccc4 is not attached to volume a0cc5544-61a5-46fe-865a-4fcba5eb9582 {{(pid=122398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 16:00:19.102486 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-c0cc90e1-47c6-4522-8d68-577d672bbd6b tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "DELETE /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4/os-volume_attachments/a0cc5544-61a5-46fe-865a-4fcba5eb9582" status: 404 len: 154 microversion: 2.1 time: 0.089188 Dec 16 16:00:19.103039 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 557/1180] 10.222.0.31 () {58 vars in 1415 bytes} [Thu Dec 16 16:00:19 2021] DELETE /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4/os-volume_attachments/a0cc5544-61a5-46fe-865a-4fcba5eb9582 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 16:00:20.243823 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-32ca1acc-6f7b-4dc7-af85-3764c533ef92 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 16:00:20.244348 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-32ca1acc-6f7b-4dc7-af85-3764c533ef92 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 16:00:20.251287 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-32ca1acc-6f7b-4dc7-af85-3764c533ef92 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 16:00:20.251742 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-32ca1acc-6f7b-4dc7-af85-3764c533ef92 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 16:00:20.252512 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-32ca1acc-6f7b-4dc7-af85-3764c533ef92 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 16:00:20.252941 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-32ca1acc-6f7b-4dc7-af85-3764c533ef92 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 16:00:20.277471 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-32ca1acc-6f7b-4dc7-af85-3764c533ef92 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Going to try to terminate instance {{(pid=122399) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 16:00:20.355499 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-32ca1acc-6f7b-4dc7-af85-3764c533ef92 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "DELETE /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 204 len: 0 microversion: 2.1 time: 0.114787 Dec 16 16:00:20.356181 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 624/1181] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Dec 16 16:00:20 2021] DELETE /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 16:00:20.365150 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-d365db01-3a55-46a3-a32f-198ca26932c2 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 16:00:20.365831 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-d365db01-3a55-46a3-a32f-198ca26932c2 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 16:00:20.373972 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d365db01-3a55-46a3-a32f-198ca26932c2 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 16:00:20.374608 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d365db01-3a55-46a3-a32f-198ca26932c2 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 16:00:20.375820 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d365db01-3a55-46a3-a32f-198ca26932c2 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 16:00:20.376343 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-d365db01-3a55-46a3-a32f-198ca26932c2 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 16:00:20.516970 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.policy [None req-d365db01-3a55-46a3-a32f-198ca26932c2 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122398) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 16:00:20.525569 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-d365db01-3a55-46a3-a32f-198ca26932c2 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1554 microversion: 2.1 time: 0.164953 Dec 16 16:00:20.526133 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 558/1182] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 16:00:20 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 16:00:21.544015 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-b253170c-fc4f-4b13-a5d3-37dc2e78bfe9 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 16:00:21.544742 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-b253170c-fc4f-4b13-a5d3-37dc2e78bfe9 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 16:00:21.551706 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b253170c-fc4f-4b13-a5d3-37dc2e78bfe9 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 16:00:21.552183 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b253170c-fc4f-4b13-a5d3-37dc2e78bfe9 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 16:00:21.552955 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b253170c-fc4f-4b13-a5d3-37dc2e78bfe9 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 16:00:21.553379 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-b253170c-fc4f-4b13-a5d3-37dc2e78bfe9 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 16:00:21.691874 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-b253170c-fc4f-4b13-a5d3-37dc2e78bfe9 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 16:00:21.699773 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-b253170c-fc4f-4b13-a5d3-37dc2e78bfe9 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1554 microversion: 2.1 time: 0.160079 Dec 16 16:00:21.700326 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 625/1183] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 16:00:21 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 16:00:22.543660 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [req-ba268246-1a81-4e7d-8c43-e9ff5b23cbb9 req-d944af9e-1fea-4fae-a883-fe67a6ad772b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93f606cd-8124-42ea-9e06-4ed5b5dcccc4", "name": "network-vif-deleted", "tag": "8d78ebca-1e6d-4075-9f3a-6c637c11bc0e"}]} {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 16:00:22.545399 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 16:00:22.545399 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: warnings.warn(msg) Dec 16 16:00:22.554395 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-ba268246-1a81-4e7d-8c43-e9ff5b23cbb9 req-d944af9e-1fea-4fae-a883-fe67a6ad772b service nova] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 16:00:22.554852 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [req-ba268246-1a81-4e7d-8c43-e9ff5b23cbb9 req-d944af9e-1fea-4fae-a883-fe67a6ad772b service nova] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 16:00:22.566501 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.compute.server_external_events [req-ba268246-1a81-4e7d-8c43-e9ff5b23cbb9 req-d944af9e-1fea-4fae-a883-fe67a6ad772b service nova] Creating event network-vif-deleted:8d78ebca-1e6d-4075-9f3a-6c637c11bc0e for instance 93f606cd-8124-42ea-9e06-4ed5b5dcccc4 on hv-cinder-78447 Dec 16 16:00:22.571586 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [req-ba268246-1a81-4e7d-8c43-e9ff5b23cbb9 req-d944af9e-1fea-4fae-a883-fe67a6ad772b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031600 Dec 16 16:00:22.572234 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 559/1184] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Dec 16 16:00:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 16:00:22.719044 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-ffe00206-3d96-4fa2-a1cd-bc2cc3360980 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 16:00:22.719709 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.compute.api [None req-ffe00206-3d96-4fa2-a1cd-bc2cc3360980 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122399) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 16:00:22.726476 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ffe00206-3d96-4fa2-a1cd-bc2cc3360980 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 16:00:22.726932 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ffe00206-3d96-4fa2-a1cd-bc2cc3360980 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 16:00:22.727707 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ffe00206-3d96-4fa2-a1cd-bc2cc3360980 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 16:00:22.728139 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ffe00206-3d96-4fa2-a1cd-bc2cc3360980 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 16:00:22.760229 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ffe00206-3d96-4fa2-a1cd-bc2cc3360980 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 16:00:22.760590 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG oslo_concurrency.lockutils [None req-ffe00206-3d96-4fa2-a1cd-bc2cc3360980 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 16:00:22.761027 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.objects.instance [None req-ffe00206-3d96-4fa2-a1cd-bc2cc3360980 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lazy-loading 'fault' on Instance uuid 93f606cd-8124-42ea-9e06-4ed5b5dcccc4 {{(pid=122399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 16:00:22.799284 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.policy [None req-ffe00206-3d96-4fa2-a1cd-bc2cc3360980 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6fd9a8b1fb42fd932f1cec4e97f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1354e5edc5f47ae9977e62b72cad47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122399) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 16:00:22.806705 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-ffe00206-3d96-4fa2-a1cd-bc2cc3360980 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 200 len: 1347 microversion: 2.1 time: 0.091774 Dec 16 16:00:22.807264 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 626/1185] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 16:00:22 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 1347 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 16:00:23.828704 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-ca1f836b-d53a-4657-bc6e-fa8566b61b3c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '>' {{(pid=122398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 16:00:23.829972 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.compute.api [None req-ca1f836b-d53a-4657-bc6e-fa8566b61b3c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] [instance: 93f606cd-8124-42ea-9e06-4ed5b5dcccc4] Fetching instance by UUID {{(pid=122398) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 16:00:23.836613 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ca1f836b-d53a-4657-bc6e-fa8566b61b3c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 16:00:23.837059 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ca1f836b-d53a-4657-bc6e-fa8566b61b3c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 16:00:23.837873 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ca1f836b-d53a-4657-bc6e-fa8566b61b3c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 16:00:23.838308 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG oslo_concurrency.lockutils [None req-ca1f836b-d53a-4657-bc6e-fa8566b61b3c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Lock "23718866-586d-4970-8765-992ef61502a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 16:00:23.853642 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.wsgi [None req-ca1f836b-d53a-4657-bc6e-fa8566b61b3c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] HTTP exception thrown: Instance 93f606cd-8124-42ea-9e06-4ed5b5dcccc4 could not be found. Dec 16 16:00:23.854233 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: DEBUG nova.api.openstack.wsgi [None req-ca1f836b-d53a-4657-bc6e-fa8566b61b3c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Returning 404 to user: Instance 93f606cd-8124-42ea-9e06-4ed5b5dcccc4 could not be found. {{(pid=122398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 16:00:23.855050 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO nova.api.openstack.requestlog [None req-ca1f836b-d53a-4657-bc6e-fa8566b61b3c tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4" status: 404 len: 111 microversion: 2.1 time: 0.033750 Dec 16 16:00:23.855600 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: [pid: 122398|app: 0|req: 560/1186] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Dec 16 16:00:23 2021] GET /compute/v2.1/servers/93f606cd-8124-42ea-9e06-4ed5b5dcccc4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 16:00:23.864095 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: DEBUG nova.api.openstack.wsgi [None req-b946616c-0963-4c16-b07f-41614c516038 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] Calling method '.version_select at 0x7fed60713700>' {{(pid=122399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 16:00:23.885373 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO nova.api.openstack.requestlog [None req-b946616c-0963-4c16-b07f-41614c516038 tempest-TestMinimumBasicScenario-760069846 tempest-TestMinimumBasicScenario-760069846-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-371717404" status: 202 len: 0 microversion: 2.1 time: 0.024881 Dec 16 16:00:23.886332 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: [pid: 122399|app: 0|req: 627/1187] 10.222.0.31 () {58 vars in 1268 bytes} [Thu Dec 16 16:00:23 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-371717404 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 16:02:02.356426 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 16:02:02.357120 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: Thu Dec 16 16:02:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 16:02:11.344461 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 16:02:11.345311 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: Thu Dec 16 16:02:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 16:03:03.826792 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 16:03:03.827851 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: Thu Dec 16 16:03:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 16:03:41.848521 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 16:03:41.849717 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: Thu Dec 16 16:03:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 16:05:22.384905 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 16:05:22.385929 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: Thu Dec 16 16:05:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 16:05:31.366994 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 16:05:31.368142 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: Thu Dec 16 16:05:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 16:05:39.262129 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 16:05:39.262693 dv-cinder-784477-11-iscsi devstack@n-api.service[122399]: Thu Dec 16 16:05:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 16:05:41.960101 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 16:05:41.960728 dv-cinder-784477-11-iscsi devstack@n-api.service[122398]: Thu Dec 16 16:05:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!